-- Logs begin at Fri 2022-04-08 01:56:32 UTC, end at Fri 2022-04-08 03:10:18 UTC. -- Apr 08 02:26:37.855360 dv-cinder-837052-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 08 02:26:37.862539 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:26:37 2022] *** Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: nodename: dv-cinder-837052-1-iscsi Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: machine: x86_64 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: clock source: unix Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: pcre jit disabled Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: detected number of CPU cores: 4 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: current working directory: / Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: your processes number limit is 47680 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: your memory page size is 4096 bytes Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: detected max file descriptor number: 2048 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: lock engine: pthread robust mutexes Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: thunder lock: enabled Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 08 02:26:37.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:26:37.907363 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: Python main interpreter initialized at 0x55a51598c9c0 Apr 08 02:26:37.907363 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: python threads support enabled Apr 08 02:26:37.907363 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: your server socket listen backlog is limited to 100 connections Apr 08 02:26:37.907363 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:26:37.907851 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:26:37.907851 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: *** Operational MODE: preforking *** Apr 08 02:26:37.908011 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:26:37.908011 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: spawned uWSGI master process (pid: 66404) Apr 08 02:26:37.908212 dv-cinder-837052-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 08 02:26:37.910173 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: spawned uWSGI worker 1 (pid: 66413, cores: 1) Apr 08 02:26:37.910173 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: spawned uWSGI worker 2 (pid: 66414, cores: 1) Apr 08 02:26:37.910173 dv-cinder-837052-1-iscsi devstack@keystone.service[66404]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:26:40.730589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:26:40.731211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:26:40.731211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] command line args: [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:26:40.731427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:26:40.731516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:26:40.731906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ================================================================================ {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:26:40.731993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:26:40.732076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] admin_token = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] command line args: [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:26:40.732224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] config_dir = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:26:40.732441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] config_source = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ================================================================================ {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:26:40.732587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] debug = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] admin_token = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.732988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] config_dir = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] config_source = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] debug = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.733987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_config_append = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_dir = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_file = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.734998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_config_append = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_dir = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_file = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.735958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.736965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.737982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] publish_errors = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.738896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] publish_errors = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] standard_threads = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.739980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] use_journal = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] standard_threads = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.740934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] use_json = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] use_stderr = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] use_syslog = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] use_journal = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.741808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] use_json = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.741881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.741951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] use_stderr = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.742080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] use_syslog = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.742156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.742308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:26:40.742392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.742563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.742640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.742825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.742906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.743067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.743157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.743298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.743399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.744923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.745873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.746992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.747970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.748897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.749891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.750953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.751966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.752857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.753939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.754985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.755944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.756990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.757979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.758947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.759948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.760919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.761854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.external = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.762966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.external = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.password = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.763922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] auth.token = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.password = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] auth.token = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.764957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.765994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.766902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.767916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.768940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.769996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.770795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.771889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.772801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.773050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.773307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.773501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.773624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.773754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.774950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.775990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.776895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.777914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.778892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.779899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780393 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.780901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.781995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.782918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.783896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.784865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.785990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.786969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.787955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.788961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.789885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.790041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.790133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.790828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.790918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.791878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.792968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.793984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.794957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.795893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.796990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] role.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] role.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.797943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] role.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] role.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.798988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.799956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.800990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.801963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.802998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.803927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.804902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805505 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.805819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.806856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.807972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.808995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.809941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.connection = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.810929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.connection = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.811871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.812986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.813926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:26:40.814454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.814885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.815129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.815384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.815626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.815861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:26:40.816036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:26:40.842119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.842343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.842567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.842813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.843052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.843284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.851617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.852361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.880110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.880342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.880710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.880947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.935844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.936079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.986924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.987080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.987214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:40.987346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.052504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.052760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.052931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.053855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.054087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.079232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.079448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.079603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.079742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.079873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.080916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.091792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.092526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.104386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.104614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.104833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66414) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.105987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.106242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.106370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:26:41.123075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.123279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:26:41.123452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.123607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.123737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:26:41.123875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:26:41.124001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:26:41.124386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.124895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.125020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.125145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.135361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.135633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.135762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.135899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.136028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.136153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.136279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.136506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.144167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.144561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.147318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.147595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.147724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.147863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.148130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.148258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.148408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.148536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.148663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.149053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.149184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.149310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.149446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.149572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.150246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.150378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.150533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.150737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.150895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.151035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.151163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.151369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.177031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.177738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.178564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.178877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.179314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.179590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.184346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.184617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.184892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.185020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.185253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.185530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.191927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.192201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.192870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.193150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.196465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.196922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.197282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.197498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.197629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.197788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.197925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.198872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.199120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.199488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.217460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.217728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.218189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.218464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.222162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.222937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.225787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.226073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.226550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.226870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.231757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.232382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.235225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.235858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.238785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.239948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.240032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.240222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.240335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.240599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.240898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.259877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.260155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.260252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.260417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.260500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.260677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.260759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.260957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.268370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.268672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.270009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.270278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.270360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.270557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.273220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.273494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.273577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.273768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.274133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.274312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.274394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.274581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.275229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.275446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.289202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.289474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.289643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.289751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.289919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.290928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.291309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.291593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.291869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.308762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.309999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.380678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.381716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.383891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.385494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.386047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.387039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.387627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.387900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.388173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.388597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.388875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.389155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.395363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.396761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.396875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.398289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.400327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.400603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.400878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.401143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.401779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.402064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.402343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.402618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.410084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.410367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.410652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.411638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.411921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.412200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.418979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66414) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.419247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.419516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.419779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.420038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.420301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.420581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.420849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.420970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:26:41.421118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.421890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66414) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.422869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.423146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.423409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.423675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.423931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.424305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.424566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:26:41.459775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55a51598c9c0 pid: 66414 (default app) Apr 08 02:26:41.462795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55a51598c9c0 pid: 66413 (default app) Apr 08 02:26:41.463106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131f23-b222-4101-b48d-6138e1ceb33a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:41.463405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131f23-b222-4101-b48d-6138e1ceb33a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:41.463690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad131f23-b222-4101-b48d-6138e1ceb33a None None] PATH_INFO: `/v3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:41.467670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Apr 8 02:26:41 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:46.825945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:46.826477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:46.826560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:46.831360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:46.836862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:46.838129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:46.838129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:46.878602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG oslo_db.sqlalchemy.engines [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:26:47.026116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG passlib.handlers.bcrypt [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66414) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Apr 08 02:26:47.026526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG passlib.handlers.bcrypt [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66414) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Apr 08 02:26:47.087645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:47.089158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:47.192166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:47.357188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:47.400838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG oslo_db.sqlalchemy.engines [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:26:47.495028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf572ac-99ae-4eeb-8c3e-e7e2ed0ce137 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:47.498971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:47.499561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.499856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.500147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.508322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:47.539998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 08 02:26:47.540872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012b4a6-dd17-4bc0-a0fb-c6170883e540 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:47.549635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:47 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:47.555578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:47.566721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4e5a7-e821-44f6-8b9d-93630e1b1de3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:47.570837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:47.572163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.572454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.572736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.574128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] RBAC: Authorizing `identity:get_project(project_id=b654bd89267e40c6bd627b095329b06e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:47.613992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 08 02:26:47.614254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898473b-fca0-4722-b741-9f0e6d832243 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:47.619212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:47 2022] GET /identity/v3/projects/b654bd89267e40c6bd627b095329b06e => generated 344 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:49.572456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1f2d-715c-4f53-aa2b-4af9431a566e None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.573032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1f2d-715c-4f53-aa2b-4af9431a566e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.573032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1f2d-715c-4f53-aa2b-4af9431a566e None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.577701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:26:49.583035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.583458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.583610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.608590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:49.610093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:49.617131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:49.638694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1f2d-715c-4f53-aa2b-4af9431a566e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.651012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1f2d-715c-4f53-aa2b-4af9431a566e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.654787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.655359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.655648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.655927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.663556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:49.690167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70452634-6fc6-4ebd-a4dd-197fc68884af admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.698919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:26:49.704469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.713692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bdf38-43c7-4b59-a067-af5e119173e1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.717642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.718435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.718763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.719047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.720298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:49.747473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c3ab1-629c-4164-9a9f-0d43fe8cc72b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.748899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:51.714300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6ee8-af2a-4766-bced-a41fb91b74c0 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.714873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6ee8-af2a-4766-bced-a41fb91b74c0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.714980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6ee8-af2a-4766-bced-a41fb91b74c0 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.716573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:51.721522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.721923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.722099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.744058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:51.745202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:51.751709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:51.773594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6ee8-af2a-4766-bced-a41fb91b74c0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.785263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6ee8-af2a-4766-bced-a41fb91b74c0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.789023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.789732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.790085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.790376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.803185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:26:51.810173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:51.811299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 6/12] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:51.816531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.825639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc0afb-50b7-4ad0-bfa0-6979599df1ae None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.829588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.830179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.830469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.830790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.831504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:26:51.831804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:51.856829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:51.856829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:26:51.856829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:26:51.857726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:51.869068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 7/13] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:51.874355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.884523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf759e4-2753-4c46-a934-082a2e7c78d0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.888447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.889223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.889515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.889797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.891319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:51.917073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:51.918513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:51.923437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.933255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba675-d716-473d-9170-4a562a9ef7cb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.937148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.937848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.938138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.938420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.939512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:51.964361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a5f47-f1b0-44eb-9b79-d4ff085bcad1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:51.965730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:51.971020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.980825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc7e75-d451-4a90-9571-b131e65351f2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.984809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.985443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.985796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.986160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.987535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.domain.id=default, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:26:51.987535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:52.013372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:52.013372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:26:52.013372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:26:52.014517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f8b2b-4131-4f9e-8c17-2bda04cbbac0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:52.021340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1343 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.domain.id=default&role.id=25829623b314474f90be394caa52cb01 => generated 233 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:53.952222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31365047-ec85-46fe-8b04-87a11f7c2224 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:53.952760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31365047-ec85-46fe-8b04-87a11f7c2224 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:53.952852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31365047-ec85-46fe-8b04-87a11f7c2224 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:53.954757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 9/17] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:53.959868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:53.960284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:53.960563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:53.992830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG passlib.handlers.bcrypt [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Apr 08 02:26:53.994063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG passlib.handlers.bcrypt [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Apr 08 02:26:54.040309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:54.041889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:54.048743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 9/18] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:54.070094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31365047-ec85-46fe-8b04-87a11f7c2224 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.082084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31365047-ec85-46fe-8b04-87a11f7c2224 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.085850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.086562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.086886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.087167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.098096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:26:54.104468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:54.105548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:54.111000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.120039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03eba0-76aa-4c27-be94-29c731c0b633 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.123983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.124575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.124876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.125163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.125874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:26:54.126176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:54.151122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:54.151122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:26:54.151122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:26:54.152018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.161426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:54.167248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.176941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80716d-4b1a-4e86-8cae-43fe09fa9ee2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.181389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.182315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.182607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.182919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.184014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:54.208945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.210282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:54.215203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.224125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104bf81-7d3e-458a-a420-322dcb2e2772 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.228625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.229318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.229610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.229894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.230995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:54.255696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b65b3-2c4c-4658-b05e-ab9ca8e4c1d3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.257089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 11/22] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:54.262407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.271275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00e23-7ee8-403e-bdb6-b3a47e3e7a8d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.275527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.276286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.276574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.276858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] PATH_INFO: `/v3/domains/default/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.278609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=53f94523980e4b8c8b9272803bd96ee5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:54.302867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:54.302867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:26:54.302867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:26:54.304775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f388f72-0394-4602-adaf-16c3b78d2f31 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.505546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1382 bytes} [Fri Apr 8 02:26:54 2022] PUT /identity/v3/domains/default/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:26:56.434436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c305-5f34-451a-ab8c-224400272d33 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.434983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c305-5f34-451a-ab8c-224400272d33 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.435095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c305-5f34-451a-ab8c-224400272d33 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.436700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:56.442789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.443156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.443371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.467159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:56.468631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:56.532371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:56.554498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c305-5f34-451a-ab8c-224400272d33 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.566541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c305-5f34-451a-ab8c-224400272d33 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.570312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.571094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.571391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.571812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.583444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:26:56.589872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:56.590969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:56.596112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.605231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbbf35-9421-474b-a471-d6f91ec38a85 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.609216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.609806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.610100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.610385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.611142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:26:56.611446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:56.637258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.648724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:56.654207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.663261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35723-f4c8-40aa-ae70-d3b6f624762e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.667729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.668505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.668797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.669077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.670158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:56.695660 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.697053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:56.701764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.710797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56c826-ecf3-407b-92c7-733711f93c5a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.714776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.715482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.715776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.716063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.717309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:56.742637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e201f9e-d168-4af5-83bf-160771598155 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.744316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 15/29] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:56.749361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.758249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77cf9c-fdb0-46d0-847c-0b786007030c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.762767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.763330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.763622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.763905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.764672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.domain.id=default, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:26:56.764976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:56.791040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6317d-13b0-4986-bf36-5acb12584691 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.796592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1343 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.domain.id=default&role.id=25829623b314474f90be394caa52cb01 => generated 530 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:58.754946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6afa-8ee9-4e63-9ad5-989d89f4dd40 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:58.755464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6afa-8ee9-4e63-9ad5-989d89f4dd40 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:58.755576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6afa-8ee9-4e63-9ad5-989d89f4dd40 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:58.757190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 16/31] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:58.762614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:58.763027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:58.763205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:58.786079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:58.787251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:58.793899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:58.814358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a6afa-8ee9-4e63-9ad5-989d89f4dd40 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:58.826144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a6afa-8ee9-4e63-9ad5-989d89f4dd40 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:58.829879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:58.830443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:58.830767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:58.831055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:58.839298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:58.864179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08689-73e2-477a-a40b-26387312a55e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:58.872821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:58.877959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:58.886899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c204b7-1aec-472f-b29d-65a57a4d1295 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:58.890788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:58.891500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:58.891792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:58.892072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:58.893122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:26:58.919017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dc856-a68a-4d4d-b1eb-ee28a3eff05a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:58.920468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 17/34] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:00.869407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf97b-fe9b-4549-a42f-77aa5b8bebe6 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:00.869929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf97b-fe9b-4549-a42f-77aa5b8bebe6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:00.870041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaf97b-fe9b-4549-a42f-77aa5b8bebe6 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:00.871689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 18/35] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:00.876633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:00.877014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:00.877221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:00.901547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:00.902760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:00.909388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:00.930715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaf97b-fe9b-4549-a42f-77aa5b8bebe6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:00.941993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaf97b-fe9b-4549-a42f-77aa5b8bebe6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:00.945767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:00.947027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:00.947320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:00.947603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:00.959313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:00.984559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.001519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:01.002594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 19/37] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:01.008189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.017671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1150ef2-e79e-4b20-8155-f6c0d20e0c24 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.021633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.022221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.022519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.022841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.023534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:01.024091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:01.049785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:01.049785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:27:01.049785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:27:01.050722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e425-0775-4444-b91f-00fca7bc95f1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.067515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:01.073303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.082345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f8f6-4487-442d-b2b7-90afac0f9178 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.086175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.087644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.087806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.088361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.089019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:01.112926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:01.112926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:27:01.112926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:27:01.114116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a7e08-1803-4f9c-908f-e57e549ff36a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.141774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:27:01 2022] POST /identity/v3/projects => generated 301 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:27:03.095730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3795cb2-08bb-4b83-aad5-15b748e0d04f None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.096318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3795cb2-08bb-4b83-aad5-15b748e0d04f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.096318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3795cb2-08bb-4b83-aad5-15b748e0d04f None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.097972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 20/40] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:03.103246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98be2-215f-42fe-bf6c-92d768e9389f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.103658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98be2-215f-42fe-bf6c-92d768e9389f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.103823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98be2-215f-42fe-bf6c-92d768e9389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.126780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3ab98be2-215f-42fe-bf6c-92d768e9389f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:03.127904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3ab98be2-215f-42fe-bf6c-92d768e9389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:03.192462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:03.214128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3795cb2-08bb-4b83-aad5-15b748e0d04f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:03.225530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3795cb2-08bb-4b83-aad5-15b748e0d04f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:03.230097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:03.230702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.230996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.231276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.231978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:03.256779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:03.256779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:27:03.256779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:27:03.257620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab81ee-d673-452f-a41b-408c78e43ab5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:03.455730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:27:03 2022] POST /identity/v3/roles => generated 219 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:27:05.414256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6fd7-e880-4daa-9352-1588cc093c05 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:05.415356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6fd7-e880-4daa-9352-1588cc093c05 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:05.415598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6fd7-e880-4daa-9352-1588cc093c05 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:05.417299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 22/43] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:05.422982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071ceb-0b63-4942-b852-acc75a366185 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:05.423382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071ceb-0b63-4942-b852-acc75a366185 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:05.423573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b071ceb-0b63-4942-b852-acc75a366185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:05.448984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6b071ceb-0b63-4942-b852-acc75a366185 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:05.450471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6b071ceb-0b63-4942-b852-acc75a366185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:05.457494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 22/44] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:05.479853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6fd7-e880-4daa-9352-1588cc093c05 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:05.491191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6fd7-e880-4daa-9352-1588cc093c05 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:05.496369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:05.496959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:05.497253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:05.497538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:05.498242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:05.522277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:05.522277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:27:05.522277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:27:05.523265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3001ce3-bfeb-4ec4-8a46-11684d927612 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:05.537706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:27:05 2022] POST /identity/v3/roles => generated 225 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:27:07.509305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6146-d8e9-4d35-a525-968ab8b6276d None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:07.509858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6146-d8e9-4d35-a525-968ab8b6276d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:07.509973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6146-d8e9-4d35-a525-968ab8b6276d None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:07.512161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 23/46] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:07.517395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd859a-9402-4f13-b903-80cdba1311b5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:07.517837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd859a-9402-4f13-b903-80cdba1311b5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:07.518191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd859a-9402-4f13-b903-80cdba1311b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:07.543535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e3cd859a-9402-4f13-b903-80cdba1311b5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:07.544689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e3cd859a-9402-4f13-b903-80cdba1311b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:07.551385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 24/47] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:07.575751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6146-d8e9-4d35-a525-968ab8b6276d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:07.588136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa6146-d8e9-4d35-a525-968ab8b6276d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:07.592235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:07.592826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:07.593119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:07.593404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:07.594107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:07.620882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893fc85-85d8-4a40-b1f7-07bd6b4a346d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:07.633035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 24/48] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:27:07 2022] POST /identity/v3/roles => generated 223 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:09.593956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d875f-a6ac-4ea9-8412-ae6e477a0051 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:09.594474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d875f-a6ac-4ea9-8412-ae6e477a0051 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:09.594558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d875f-a6ac-4ea9-8412-ae6e477a0051 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:09.596222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 25/49] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:09.601326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:09.601753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:09.601909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:09.629010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:09.630172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:09.637090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:09.659321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d875f-a6ac-4ea9-8412-ae6e477a0051 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:09.677588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d875f-a6ac-4ea9-8412-ae6e477a0051 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:09.682081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:09.682838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:09.683131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:09.683412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:09.684611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:09.710318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd382-29ed-4dae-89c1-fd0ee06bef9f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:09.712884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 26/51] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:09.721228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:09.733869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930b7d1-6795-4f6f-81b1-dbec6b20709b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:09.738488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:09.739124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:09.739422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:09.739711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:09.740811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:09.768562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:09.768562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:27:09.768562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:27:09.769795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37be163-472f-44bf-bd22-148a55c63f90 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:09.809040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:27:09 2022] POST /identity/v3/projects => generated 312 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:27:11.797599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a4e9-d2a0-4e2a-84bc-6869c984e82f None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.798132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a4e9-d2a0-4e2a-84bc-6869c984e82f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.798217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a4e9-d2a0-4e2a-84bc-6869c984e82f None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.799878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 27/53] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:11.804900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.805865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.806106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.827982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:11.829118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:11.900379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 27/54] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:11.923269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a4e9-d2a0-4e2a-84bc-6869c984e82f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.935835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a4e9-d2a0-4e2a-84bc-6869c984e82f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.939658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.940390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.940685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.940973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.942083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:11.968641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf686a0e-fa16-46bc-abd7-96efdd5b8be8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.970157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:11.975672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.985276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60534534-04e1-4637-b3ca-69691dc70206 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.989539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.990139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.990438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.990761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.991427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:12.019161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd17ee1-a732-4727-91bc-7168ec6b1f6f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:12.045895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 28/56] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Apr 8 02:27:11 2022] POST /identity/v3/projects => generated 298 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:14.014361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0761-39e3-48b5-9cd9-9057e3ac4a5d None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:14.014815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0761-39e3-48b5-9cd9-9057e3ac4a5d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:14.014965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0761-39e3-48b5-9cd9-9057e3ac4a5d None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:14.016914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 29/57] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:14.021920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:14.022276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:14.022506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:14.044743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:14.045878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:14.109099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 29/58] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:14.131990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0761-39e3-48b5-9cd9-9057e3ac4a5d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:14.143653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0761-39e3-48b5-9cd9-9057e3ac4a5d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:14.147397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:14.148110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:14.148402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:14.149258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:14.150459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:14.175787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571eeee-8509-4e93-a793-6cbee5647af3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:14.177207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:14.182256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:14.190788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3e267-93b4-477a-bcd5-dc0de8425248 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:14.194640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:14.195257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:14.195582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:14.195866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:14.196527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:14.221143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:14.221143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:27:14.221143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:27:14.222344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376d4ca-a973-478c-8a2c-c5e03b6144a3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:14.245512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 30/60] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:27:14 2022] POST /identity/v3/users => generated 275 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:16.220619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe328-1d36-4c64-802a-c90efd54c946 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.221227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe328-1d36-4c64-802a-c90efd54c946 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.221227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe328-1d36-4c64-802a-c90efd54c946 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.222886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 31/61] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:16.228332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.228744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.228917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.251263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:16.252351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:16.259057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:16.283672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe328-1d36-4c64-802a-c90efd54c946 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.295722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe328-1d36-4c64-802a-c90efd54c946 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.299573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.300286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.300577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.300857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.311792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:16.318164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:16.319261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 32/63] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:16.325253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.333798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65ad7-4203-4db8-b902-42df71a46c9f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.339057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.339658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.339956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.340245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.340971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:16.341280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:16.366875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:16.375670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 32/64] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:16.380731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.390796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef4591-8171-4604-bc98-935416514a11 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.394698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.395475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.395765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.396048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.415756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:16.441449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:16.442934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 33/65] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:16.448355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.457507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af09cb-5e29-459c-bd49-786a37899005 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.462213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.462823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.463121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.463428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.470973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:16.497038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:16.505405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:16.510468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.519462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ef43-edc4-4c54-a7b1-a276fb7dc13f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.523344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.524914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.525203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.525482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.526555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:16.551977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756df371-67e2-4105-bcf3-80e6cc2d6661 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:16.553460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 34/67] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:16.559485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:16.567839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69274-c0b8-4222-800e-290262b1cc8b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:16.571980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:16.572554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:16.572854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:16.573146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:16.573931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:16.574246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:16.601055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc625b0-3f43-438c-a11e-b7c0a71404b9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:16.607243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 34/68] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:16 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=29d45dc2a84042c5837937965c286615 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.547765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a741c-8b19-4fbc-8a97-9dff5e3ce8f7 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.548276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a741c-8b19-4fbc-8a97-9dff5e3ce8f7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.548383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a741c-8b19-4fbc-8a97-9dff5e3ce8f7 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.550027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 35/69] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:18.555713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.556125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.556288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.579271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:18.580424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:18.587333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:18.608066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a741c-8b19-4fbc-8a97-9dff5e3ce8f7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.619956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a741c-8b19-4fbc-8a97-9dff5e3ce8f7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.623728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.624439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.624728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.625011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.636738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:18.643127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:18.644180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:18.649796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.658184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d832a-891c-4a3b-a0ef-a90c5898fcad None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.662111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.662732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.663032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.663323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.664035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:18.664442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:18.689747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.698162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.703227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.713542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755dc45-2334-4ccf-821c-47c98cffe4c4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.717406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.718174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.718463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.718775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.719853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:18.745540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.746978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.751825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.761381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1c09c-c1d7-44b7-b6a1-f2df06d64e68 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.765269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.766036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.766329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.766614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.767728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:18.793746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4a69-9673-4158-97e7-1b7592ad9cec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.795404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.804259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.817059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452c2a-1812-42a8-bfd4-3aea756f01b3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.829003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.829850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.830147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.830436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/158f1c26a6c8482b805b78156890152f/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.832626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b9f8cc5db14331a52eb044c4aab7f7, user_id=158f1c26a6c8482b805b78156890152f, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:18.863200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe7409-58b7-4b88-a771-f0a5fcb7c828 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.876781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 38/75] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:18 2022] PUT /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/158f1c26a6c8482b805b78156890152f/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:27:20.828089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929a43-16a2-4c1d-91db-3c2ac174165c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.828656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929a43-16a2-4c1d-91db-3c2ac174165c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.828656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929a43-16a2-4c1d-91db-3c2ac174165c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.830340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 38/76] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:20.835383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.835777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.835999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.858270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:20.859463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:20.922465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 39/77] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:20.944622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929a43-16a2-4c1d-91db-3c2ac174165c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.956864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929a43-16a2-4c1d-91db-3c2ac174165c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.960768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.961497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.961845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.962276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.977466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:20.984007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:20.985126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:20.990912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:21.000293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ef82-209d-4480-9242-eba55d754a33 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:21.004294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:21.004889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:21.005186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:21.005476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:21.006198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:21.006501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:21.032748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:21.041166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:21.046474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:21.056247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a450f-4a55-4795-be3e-dca9bba819fe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:21.060245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:21.061037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:21.061334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:21.061621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:21.062952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:21.089485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:21.090913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:21 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:21.095925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:21.105184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09d4a-08ef-4ec6-abd8-e76bf01b3e16 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:21.109223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:21.109790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:21.110087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:21.110378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:21.118620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:21.143749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:21.152359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 41/81] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:21.157578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:21.167381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dabfb-eda2-420c-9b23-951caec50629 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:21.171404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:21.172176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:21.172470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:21.172756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:21.173832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:21.200119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce8744-9a13-4983-ab95-2f5f14ab60f8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:21.201614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:21 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:21.206883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:21.215753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50084f8-6d6e-4932-9bfb-70a35de0f044 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:21.219781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:21.220351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:21.220645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:21.220933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:21.221712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:21.222020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:21.251032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:21.251032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:27:21.251032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:27:21.252181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7f9eb-e6b4-4fc0-83c9-3db370f0f39e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:21.258938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:21 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=29d45dc2a84042c5837937965c286615 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.232216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9302-c065-4812-ab8a-cae9bc8f48c1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.232720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9302-c065-4812-ab8a-cae9bc8f48c1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.232827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e9302-c065-4812-ab8a-cae9bc8f48c1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.234431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 42/84] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:23.239575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.239989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.240085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.263273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:23.264399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:23.270910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:23.292472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e9302-c065-4812-ab8a-cae9bc8f48c1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.303739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e9302-c065-4812-ab8a-cae9bc8f48c1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.308108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.308814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.309107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.309392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.321025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:23.327333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:23.328394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:23.333595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.342762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24763f-c189-4cd5-a716-3965c7c50007 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.346621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.347239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.347531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.347816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.348529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:23.348828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:23.374274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.382598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.388364 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.397302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6bb7-3496-4737-a4b5-b3516a9dab2d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.401622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.402397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.402713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.403005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.404074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:23.430236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.431689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.436600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.445667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83859-068c-4e4e-946d-7000ade790a0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.449574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.450138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.450434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.450761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.458354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:23.484437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.493668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:23.498938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.508358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f8c76-4f77-4aae-8ddf-2bd7e0259e4a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.512370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.513161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.513456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.513745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.514871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:23.541971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8f514-e3d1-44e2-9fc2-04101b7f1745 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.543533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.548970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.558035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2c009-0d8a-44aa-a4d7-5ca95ad21330 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.562028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.562603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.562934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.563222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.564001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:23.564310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:23.589587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bc65-23ef-4f83-a155-ace718a5ac8f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.594834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:25.498120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49dec-4e9d-4b86-add6-555ce712e076 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.498638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49dec-4e9d-4b86-add6-555ce712e076 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.498761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49dec-4e9d-4b86-add6-555ce712e076 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.500375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 46/92] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:25.505356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.505756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.505937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.529881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:25.531060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:25.537704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 47/93] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:25.559112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49dec-4e9d-4b86-add6-555ce712e076 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:25.571099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49dec-4e9d-4b86-add6-555ce712e076 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:25.574945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:25.575664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.575960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.576245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.587114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:25.593419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:25.594486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 47/94] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:25.599577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:25.608227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d4da-b29c-496a-9d96-8357f8d05325 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:25.612137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:25.612734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.613025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.613305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.614021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:25.614322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:25.640610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:25.649737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 48/95] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:25.655219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:25.665756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca447b3b-9ded-48c3-aebd-db6a57dcca39 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:25.669677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:25.670470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.670798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.671082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.672168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:25.697771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:25.699224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:25 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:25.704163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:25.713244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f482d-608b-4b6d-bca1-2b1750c43694 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:25.717147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:25.717918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.718212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.718496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.719601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:25.746115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8f62a-43ed-49c5-82a6-7d21bbcc8fa0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:25.747631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:25 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:25.752792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:25.761921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b57c40-5b48-40a9-a610-44e37535acf3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:25.765837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:25.766633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:25.766960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:25.767247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:25.768983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b9f8cc5db14331a52eb044c4aab7f7, user_id=53f94523980e4b8c8b9272803bd96ee5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:25.794227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:25.794227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:27:25.794227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:27:25.796182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cabe9b-1233-4f0f-9bd3-69dde62c6ced admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:25.809363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 49/98] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:25 2022] PUT /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:27.750682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2088a7-a5db-4e70-ac77-1e21ad7264ed None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:27.751227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2088a7-a5db-4e70-ac77-1e21ad7264ed None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:27.751316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2088a7-a5db-4e70-ac77-1e21ad7264ed None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:27.753226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 50/99] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:27.758195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:27.758604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:27.758799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:27.781286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:27.782419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:27.847433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 50/100] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:27.869820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2088a7-a5db-4e70-ac77-1e21ad7264ed None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:27.881266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2088a7-a5db-4e70-ac77-1e21ad7264ed None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:27.885630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:27.886351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:27.886646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:27.886966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:27.899602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:27.906338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:27.907740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:27.913275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:27.922285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53f30e-cf94-4388-b9d2-388333f42def None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:27.926261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:27.926891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:27.927184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:27.927469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:27.928180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:27.928484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:27.954244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:27.964033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:27.969584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:27.979540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb5596-465e-413e-93a3-56cfde6e3b62 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:27.983494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:27.984290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:27.984583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:27.984869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:27.985946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:28.012451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.013869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 52/103] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:27 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:28.019107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.028633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f08f5-addd-4ac4-b5bf-59a1e1706602 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.032507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.033076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.033369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.033653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.041815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:28.067344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.075644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 52/104] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:28.080795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.090359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec06b7-bff9-4ab2-b2f1-6cd52806a4d0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.094394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.095223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.095517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.095805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.096879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:28.123664 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74398ab0-e93b-4b51-873c-03d254b5fcc9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.125153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 53/105] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:28.130451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.139070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad375-a1e4-4c31-85ac-4bb519f01abf admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.142960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.143527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.143819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.144106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.144872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:28.145180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:28.171771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed07023-c3b8-457b-b9bb-3f19fe8db597 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.177311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 53/106] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:30.151798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7508ec-0ad9-4c2d-91f3-b99341540731 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.152302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7508ec-0ad9-4c2d-91f3-b99341540731 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.152384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7508ec-0ad9-4c2d-91f3-b99341540731 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.154034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 54/107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:30.158989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.159349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.159573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.182857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:30.183996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:30.190568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 54/108] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:30.211996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7508ec-0ad9-4c2d-91f3-b99341540731 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.223341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7508ec-0ad9-4c2d-91f3-b99341540731 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.227620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.228338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.228630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.228912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.239841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:30.246515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:30.247595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:30.252859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.261768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150e39d-ed43-46ca-b7f7-f7df422b92d1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.265760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.266349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.266644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.266958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.267671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:30.267978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:30.294040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:30.302235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 55/110] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:30.307371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.317233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0cbd9-6401-4d3d-8d9f-2ed33e89e6b4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.321827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.322600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.322937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.323223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.324310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:30.350405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:30.352150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:30.357192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.366110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bd1dc-46c6-4c1e-952f-2ad77bb0709e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.370251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.370854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.371153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.371441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.378957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:30.405057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:30.413390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:30.418920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.427902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172bab6-d69c-436e-947b-42688f99e018 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.432376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.433141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.433434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.433723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.434820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:30.460095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd439a47-a0d3-4cf9-bae7-f92f87ecc80b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:30.461757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:30.467045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:30.475239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dfd8c-c32f-4d38-ae1a-2db7a75feafe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:30.479677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:30.480245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:30.480536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:30.480819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:30.481581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:30.481885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:30.508733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01075be0-1e47-4752-b49f-0340d8330341 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:30.513955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:30 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:32.479563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458e8c-0c1d-43b2-85eb-56d4fddc09cb None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.480075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458e8c-0c1d-43b2-85eb-56d4fddc09cb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.480158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458e8c-0c1d-43b2-85eb-56d4fddc09cb None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.481807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 58/115] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:32.486981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.487381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.487567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.511528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:32.512678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:32.519360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:32.541234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458e8c-0c1d-43b2-85eb-56d4fddc09cb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:32.552533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458e8c-0c1d-43b2-85eb-56d4fddc09cb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:32.557011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:32.557765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.558067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.558354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.569303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:32.576497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:32.577563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 59/117] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:32.582810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:32.592145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf32d3a-6d35-4abe-b640-8fe324b2c41b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:32.596019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:32.596612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.596905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.597190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.597898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:32.598198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:32.625116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:32.634074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 59/118] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:32.639648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:32.650382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def31a8-6cc0-4b0d-90e4-8f8ac181b75d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:32.654295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:32.655128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.655423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.655709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.656793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:32.683748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:32.685202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 60/119] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:32 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:32.690410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:32.699755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91913d0-d70b-4517-9cd2-f91c39ef3de3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:32.703807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:32.704601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.704901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.705192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.706293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:32.733404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159798e-9015-498a-b197-1da99736d677 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:32.734902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:32 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:32.739917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:32.749636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0427cd-6e20-49e8-85da-91caa302d3bf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:32.753555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:32.754350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:32.754645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:32.754961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/158f1c26a6c8482b805b78156890152f/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:32.756903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b9f8cc5db14331a52eb044c4aab7f7, user_id=158f1c26a6c8482b805b78156890152f, role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:32.783788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709cc59-1914-416a-b7a0-8a3e6d05449d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:32.796169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:32 2022] PUT /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/users/158f1c26a6c8482b805b78156890152f/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:34.761729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c724-10e3-42c7-8a5d-693c4db09548 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.762276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c724-10e3-42c7-8a5d-693c4db09548 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.762375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c724-10e3-42c7-8a5d-693c4db09548 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.764020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 61/122] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:34.769023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.769402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.769604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.793549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:34.794718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:34.857139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 62/123] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:34.879646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c724-10e3-42c7-8a5d-693c4db09548 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.891171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c724-10e3-42c7-8a5d-693c4db09548 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.895030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.895762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.896057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.896345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.908273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:34.915712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:34.916794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 62/124] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.922121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.930655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74b44b-f7d1-439f-a720-52fbaa0438d9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.934835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.935420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.935712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.935995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.936704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:34.937004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:34.963038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.971977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 63/125] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:34.978565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.987818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf29519-7d49-4095-ba16-e0dd41dd486a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.991745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.992690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.992982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.993265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.994353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:35.020826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:35.022250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 63/126] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:35.028602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:35.037895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4fe0b-3cc2-4c66-8e33-649f517ff6ef admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:35.041887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:35.042465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:35.042801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:35.043096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:35.050656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:35.076825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:35.085173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 64/127] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:35.090273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:35.099360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a191c5-0904-42c4-a48d-9b740cb79cc9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:35.103440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:35.104210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:35.104502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:35.104786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:35.105853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:35.132027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52eea0-0707-4a80-9dab-ac9b5228d92f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:35.134470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 64/128] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:35 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:35.139798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:35.148717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568d06-aa79-46cc-8012-46139e1c80d0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:35.152985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:35.153557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:35.153853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:35.154143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:35.154959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:35.155271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:35.181240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba221-9658-4004-b6c1-3c54c35c22a7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:35.186903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 65/129] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:35 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.168072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e805f7-a08d-4a00-9438-6f829f7c1a35 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.168603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e805f7-a08d-4a00-9438-6f829f7c1a35 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.168694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e805f7-a08d-4a00-9438-6f829f7c1a35 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.170297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 65/130] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:37.175215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.175625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.175797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.198496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:37.199666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:37.206174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 66/131] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:37.228056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e805f7-a08d-4a00-9438-6f829f7c1a35 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.239600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e805f7-a08d-4a00-9438-6f829f7c1a35 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.244021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.244740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.245038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.245327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.256573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:37.263666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:37.264742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 66/132] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:37.269933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.279407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8d7f8-63c6-4f63-8424-562539e6163e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.283347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.283939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.284237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.284526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.285241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:37.285548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:37.311312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.320261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 67/133] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.325458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.335465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a353b8a-ad60-42f0-8905-9de2655774d0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.339523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.340309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.340604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.340893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.341968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:37.368573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.370003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 67/134] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.375086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.384746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260cbe9-b773-4ba1-b139-2e4f22a0a737 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.388652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.389223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.389519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.389805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.397391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:37.422709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.431607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:37.436605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.446701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1df39f-4485-4e4b-8a3c-a1675e029dd6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.450598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.451398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.451693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.451975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] PATH_INFO: `/v3/projects/ee1708718eed48949cddfa4a288076ca` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.453039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee1708718eed48949cddfa4a288076ca)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:37.479061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9b07-2171-4b3d-ba01-e37d40b06573 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.480546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 68/136] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/projects/ee1708718eed48949cddfa4a288076ca => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.485784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.494625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737556d7-550e-49de-979c-41231b393ee3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.498485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.499092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.499386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.499671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.500455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=ee1708718eed48949cddfa4a288076ca, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:37.500762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:37.526940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267e868-3de9-46ac-ac94-8f7c445bae87 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.532189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 69/137] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=ee1708718eed48949cddfa4a288076ca&role.id=29d45dc2a84042c5837937965c286615 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.455426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf365-37b9-41c6-88ce-ebb8cd69d71b None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.455942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf365-37b9-41c6-88ce-ebb8cd69d71b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.456050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bf365-37b9-41c6-88ce-ebb8cd69d71b None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.457652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 69/138] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:39.463211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.463583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.463794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.486380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:39.487541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:39.494727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 70/139] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:39.515835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bf365-37b9-41c6-88ce-ebb8cd69d71b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.528192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bf365-37b9-41c6-88ce-ebb8cd69d71b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.532169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.532898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.533199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.533490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.545193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:39.551566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:39.552653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 70/140] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.558410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.567266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad44dd3-1999-410e-8a7b-45bd3eb07345 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.571406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.571999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.572292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.572577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.573294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:39.573597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:39.598983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.608013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 71/141] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.613344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.623835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d03011-03da-4f52-a91d-e5bf053399a0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.627760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.628554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.628852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.629140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.630239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:39.656835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.658268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 71/142] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.663314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.673314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d05a5-3647-476b-804a-afa3a928c64c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.677221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.678001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.678297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.678586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] PATH_INFO: `/v3/projects/ee1708718eed48949cddfa4a288076ca` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.679791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee1708718eed48949cddfa4a288076ca)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:39.705288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d7b80-d478-419c-afe8-f5d12de4e762 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.706869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 72/143] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/projects/ee1708718eed48949cddfa4a288076ca => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.712579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.721693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460912-f06a-437a-8aea-4f0b0940bf44 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.725623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.727046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.727340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.727627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] PATH_INFO: `/v3/projects/ee1708718eed48949cddfa4a288076ca/users/158f1c26a6c8482b805b78156890152f/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.729368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1708718eed48949cddfa4a288076ca, user_id=158f1c26a6c8482b805b78156890152f, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:39.755319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b701e-fdbf-47e5-b15e-c6ce354aebfa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.768553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 72/144] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:39 2022] PUT /identity/v3/projects/ee1708718eed48949cddfa4a288076ca/users/158f1c26a6c8482b805b78156890152f/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:41.699578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb1cf-9efc-4042-a1ea-229f7475a146 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.700127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb1cf-9efc-4042-a1ea-229f7475a146 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.700224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb1cf-9efc-4042-a1ea-229f7475a146 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.701841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 73/145] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:41.706949 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.707375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.707524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.730107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:41.731257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:41.795182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 73/146] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:41.816891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eb1cf-9efc-4042-a1ea-229f7475a146 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:41.828292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eb1cf-9efc-4042-a1ea-229f7475a146 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:41.832105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:41.832825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.833118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.833402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.845596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:41.852699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:41.853768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:41.859016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:41.867302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02975391-156f-4365-a3a6-55f1622f7711 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:41.871168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:41.871756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.872050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.872335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.873041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:41.873343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:41.899526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:41.908136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:41.913257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:41.922930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6d5cf-2d13-4f56-8ed6-66088812fa23 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:41.926916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:41.927699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.927995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.928281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.929414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:41.954883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:41.956426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:41 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:41.961986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:41.970973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd880b-3e8d-4ccb-a46e-7afa0c69ce91 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:41.974832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:41.975395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:41.975688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:41.976580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:41.984255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:42.010165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.018601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 75/150] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:42.024834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.033964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6909-2be2-4792-b74a-3b2d1c3e6ee3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.037869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.038761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.039061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.039350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] PATH_INFO: `/v3/projects/ee1708718eed48949cddfa4a288076ca` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.040423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee1708718eed48949cddfa4a288076ca)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:42.066190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6b1c-9027-4ebc-85ab-821ff7fe95d0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.067740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 76/151] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/projects/ee1708718eed48949cddfa4a288076ca => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:42.073668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.081966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a228c9-2ba5-4613-8ed9-606b03ffd656 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.086200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.086811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.087106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.087391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.088170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=ee1708718eed48949cddfa4a288076ca, user.id=158f1c26a6c8482b805b78156890152f) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:42.088480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:42.113873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d9f46-984a-411c-9f61-b13f316d9317 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.120403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 76/152] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/role_assignments?user.id=158f1c26a6c8482b805b78156890152f&scope.project.id=ee1708718eed48949cddfa4a288076ca&role.id=29d45dc2a84042c5837937965c286615 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:44.148647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903be98-6f42-4c6f-b280-b396253d6ca8 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.149447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903be98-6f42-4c6f-b280-b396253d6ca8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.149619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903be98-6f42-4c6f-b280-b396253d6ca8 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.151351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 77/153] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:44.156417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b36d5-d904-44af-be0b-214546beed74 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.156815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b36d5-d904-44af-be0b-214546beed74 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.156995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b36d5-d904-44af-be0b-214546beed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.179679 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-347b36d5-d904-44af-be0b-214546beed74 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:44.181604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-347b36d5-d904-44af-be0b-214546beed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:44.188158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 77/154] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:44.209266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903be98-6f42-4c6f-b280-b396253d6ca8 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:44.220638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903be98-6f42-4c6f-b280-b396253d6ca8 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:44.224434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:44.225142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.225435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.225720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.226799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:44.252913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606c55-ccaa-4912-a11b-ce6f59779cb5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:44.254285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 78/155] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:44.259647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b36d5-d904-44af-be0b-214546beed74 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:44.267980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b36d5-d904-44af-be0b-214546beed74 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:44.271837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:44.272412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.272700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.272980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.273617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:44.299712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a3896-d47e-4332-a418-3a9f4c6aaf3c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:44.325644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 78/156] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:27:44 2022] POST /identity/v3/projects => generated 302 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:46.284499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348232b4-4b2a-40c6-b222-83581ed7ddb3 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:46.285001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348232b4-4b2a-40c6-b222-83581ed7ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:46.285001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348232b4-4b2a-40c6-b222-83581ed7ddb3 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:46.286746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 79/157] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:46.291777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:46.292191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:46.292349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:46.313758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:46.314916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:46.376245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 79/158] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:46.399459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348232b4-4b2a-40c6-b222-83581ed7ddb3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:46.410789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348232b4-4b2a-40c6-b222-83581ed7ddb3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:46.415134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:46.415928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:46.416220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:46.416504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:46.417550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:46.442971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e060b64-27f2-4751-8ae4-b6c3047ac400 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:46.444383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 80/159] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:46.449463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:46.457745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595807c6-fdfc-44c1-a812-ec9cec0c5466 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:46.461686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:46.462366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:46.462655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:46.462959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:46.463606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:46.489269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d14af7-a458-4d71-b0fe-f2179892ac73 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:46.508208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 80/160] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:27:46 2022] POST /identity/v3/users => generated 283 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:48.565254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26afd4-41c3-499b-b3d4-ac941e412daa None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.565790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26afd4-41c3-499b-b3d4-ac941e412daa None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.565790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26afd4-41c3-499b-b3d4-ac941e412daa None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.567534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 81/161] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:48.573286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.573707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.573857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.595872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:48.597019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:48.604284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:48.626243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26afd4-41c3-499b-b3d4-ac941e412daa None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.637828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26afd4-41c3-499b-b3d4-ac941e412daa None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.641640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.642348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.642639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.642947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.655074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:48.661391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:48.662444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 82/163] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:48.668063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.676698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ac9e-2a2f-4e0e-85ec-226ec28b5db6 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.681185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.681770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.682059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.682340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.683082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:48.683386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:48.708315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:48.716929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 82/164] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:48.721944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.731581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41981e-8ad3-4b53-b7a0-19e6a8c73108 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.735470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.736242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.736532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.736812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.754853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:48.781481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:48.782962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:48.788058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.797609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e647b90-e703-4b72-98e8-892e49582296 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.801508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.802077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.802372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.802658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.810658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:48.837562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:48.845788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 83/166] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:48.850740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.859708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205deb3-52d8-46cb-847d-ebc6bfb97cbe admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.863550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.864311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.864601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.864887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.865945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:48.891936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e0e0d-87ac-4481-b09a-ebb91e79bd8e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:48.893434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:48.899411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:48.910333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954f992-05a5-4761-844d-18440ab27373 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:48.916156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:48.916725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:48.917013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:48.917294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:48.918062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=f331d7ea66b64ecf88c0a3742b8c00a0) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:48.918366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:48.943750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5bea7-e89c-4541-8c7f-b6d4a6e5b35c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:48.949429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 84/168] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:48 2022] GET /identity/v3/role_assignments?user.id=f331d7ea66b64ecf88c0a3742b8c00a0&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=29d45dc2a84042c5837937965c286615 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:50.881756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bd1-413b-4e52-8cbe-b8687dc67717 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:50.882318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bd1-413b-4e52-8cbe-b8687dc67717 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:50.882318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bd1-413b-4e52-8cbe-b8687dc67717 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:50.884551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 85/169] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:50.889546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:50.889925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:50.890124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:50.913280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:50.914504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:50.921168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:50.942815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1bd1-413b-4e52-8cbe-b8687dc67717 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:50.955053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1bd1-413b-4e52-8cbe-b8687dc67717 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:50.958821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:50.959533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:50.959825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:50.960108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:50.971559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:50.977946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:50.979040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 86/171] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:50.984466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:50.993004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2c09-35ba-48e1-a759-85213f3ebd9a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:50.996845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:50.997440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:50.997730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:50.998013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:50.998746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:50.999046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:51.025437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.033755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 86/172] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:51.039192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.049341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683c4f2-aece-496a-ad55-79ebd4531707 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.053196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.053974 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.054269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.054551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.056078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:51.082120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.083584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 87/173] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:51 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:51.089117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.098133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ced3-942e-46e3-9a21-debe962655f7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.101925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.102714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.103005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.103287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.104354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:51.130242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609902fb-c5f8-45e5-acf9-f5af793e6321 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.131750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 87/174] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:51 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:51.137963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.146869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6924-0128-4edb-afc1-e7b3a68deb3b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.151492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.152272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.152559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.152838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85/users/f331d7ea66b64ecf88c0a3742b8c00a0/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.154530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5401064486ed43bab740ef11fb147a85, user_id=f331d7ea66b64ecf88c0a3742b8c00a0, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:51.181472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e9513-2909-494b-ad41-ad7be2792dcb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.193150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 88/175] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:51 2022] PUT /identity/v3/projects/5401064486ed43bab740ef11fb147a85/users/f331d7ea66b64ecf88c0a3742b8c00a0/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:27:53.136107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384538-5b91-498e-9e18-3c806d9b6364 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.136610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384538-5b91-498e-9e18-3c806d9b6364 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.136692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384538-5b91-498e-9e18-3c806d9b6364 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.138356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 88/176] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:53.143444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995477-964f-454b-bfa9-ea387b085932 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.143809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995477-964f-454b-bfa9-ea387b085932 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.144008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995477-964f-454b-bfa9-ea387b085932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.166881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-25995477-964f-454b-bfa9-ea387b085932 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:53.168001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-25995477-964f-454b-bfa9-ea387b085932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:53.231186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 89/177] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:53.252873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384538-5b91-498e-9e18-3c806d9b6364 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.264843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384538-5b91-498e-9e18-3c806d9b6364 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.268643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.269358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.269654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.269942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.282609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:53.289027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:53.290155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 89/178] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:53.295507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995477-964f-454b-bfa9-ea387b085932 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.303860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995477-964f-454b-bfa9-ea387b085932 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.307895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.308479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.308769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.309050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.309761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:53.310059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:53.335545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:53.344472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 90/179] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:53.349544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.358860 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133993d-5f5f-49d7-82a8-f8ab94b52cb8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.362692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.363482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.363776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.364063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.365156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:53.392294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:53.393715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 90/180] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:53.398561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.407920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345d5cd-2915-478d-9c5a-dd060179121e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.411721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.412278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.412567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.412850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.420509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:53.446528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:53.454710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 91/181] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:53.459671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.469121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49385-ae79-4503-a236-8f46c9264876 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.472923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.473687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.473978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.474261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.475348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:53.501253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a7aaa-0f61-4866-9647-71f43064ec43 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:53.502770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 91/182] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:53.507903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:53.516077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb87c6-5051-4e0a-be9d-3a0ea16b463c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:53.519912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:53.520473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.520761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.521042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.521809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] RBAC: Adding query filter params (role.id=29d45dc2a84042c5837937965c286615, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=f331d7ea66b64ecf88c0a3742b8c00a0) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:53.522111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:53.548379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacf37c-350e-487c-95ea-496cc4603d47 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:53.553944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 92/183] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:53 2022] GET /identity/v3/role_assignments?user.id=f331d7ea66b64ecf88c0a3742b8c00a0&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=29d45dc2a84042c5837937965c286615 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:55.540041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075d88-2bc4-45f3-bed8-34179d83ef71 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.540579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075d88-2bc4-45f3-bed8-34179d83ef71 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.540668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075d88-2bc4-45f3-bed8-34179d83ef71 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.542280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 92/184] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:55.547394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91979-7102-4914-835f-c74097478571 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.547804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91979-7102-4914-835f-c74097478571 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.547986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91979-7102-4914-835f-c74097478571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.572293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4ef91979-7102-4914-835f-c74097478571 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:55.573428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4ef91979-7102-4914-835f-c74097478571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:55.579903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:55.601453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96075d88-2bc4-45f3-bed8-34179d83ef71 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.613634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96075d88-2bc4-45f3-bed8-34179d83ef71 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.617984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.618746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.619040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.619323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.630206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:55.636554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:55.637624 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 93/186] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:55.642910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91979-7102-4914-835f-c74097478571 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.651841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91979-7102-4914-835f-c74097478571 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.655625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.656206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.656490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.656766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.657473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:55.657769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:55.683270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:55.691609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 94/187] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:55.696898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.706969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680570-bec6-42d8-bd89-42b73e2efd0d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.710748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.712097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.712385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.712666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.713738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:55.739286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:55.740708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 94/188] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:55.745686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.754509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83b34-66f1-40ea-887e-35705f8b4adf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.758276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.758863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.759152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.759431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.766844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:55.792261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:55.800337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 95/189] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:55.805871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.814824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7200-fc6b-4d32-b82a-f17b65a840f6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.818602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.819397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.819686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.819967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.821601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:55.847357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908549-3867-47eb-aa42-21b9909a0fe0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:55.848839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 95/190] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:55.854077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:55.862164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988b99-a5db-4c2b-aecd-7727b4ab9905 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:55.865930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:55.866483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:55.866801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:55.867081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:55.868381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:55.868676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:55.894213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b462f-6e15-4189-9924-86456e12d0f2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:55.899679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 96/191] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:55 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:57.828450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c827ca-0a19-4502-aa57-6a89a71b6774 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:57.828994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c827ca-0a19-4502-aa57-6a89a71b6774 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:57.828994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c827ca-0a19-4502-aa57-6a89a71b6774 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:57.830688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 96/192] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:57.835750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718e6-aa58-4110-b672-62361108192c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:57.836721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718e6-aa58-4110-b672-62361108192c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:57.836985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1718e6-aa58-4110-b672-62361108192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:57.858711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3b1718e6-aa58-4110-b672-62361108192c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:57.859824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3b1718e6-aa58-4110-b672-62361108192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:57.866142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 97/193] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:57.888078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c827ca-0a19-4502-aa57-6a89a71b6774 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:57.899707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c827ca-0a19-4502-aa57-6a89a71b6774 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:57.903532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:57.904234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:57.904523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:57.904802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:57.916825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:27:57.923126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:57.924192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 97/194] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:57.929407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1718e6-aa58-4110-b672-62361108192c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:57.938286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1718e6-aa58-4110-b672-62361108192c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:57.942185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:57.942798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:57.943086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:57.943366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:57.944071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:27:57.944368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:57.969560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:57.978140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 98/195] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:57.983405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:57.994111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8666cf-c553-4c8f-8320-5060a56c4027 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:57.997912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:57.998733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:57.999028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:57.999311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.000391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:58.026600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.028084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 98/196] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:27:57 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:58.033301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.042525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df909-0171-4194-806b-9d686507b793 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.046335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.047146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.047442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.047722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.048779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:58.075299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b32a5-cb19-4d2d-9c76-a3b88364de18 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.076791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:58.081936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.090959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839276-fc64-473a-b4e9-f5f21c6b56d1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.094726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.095520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.095806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.096081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.097786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5401064486ed43bab740ef11fb147a85, user_id=53f94523980e4b8c8b9272803bd96ee5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:27:58.124203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5be651-c1f2-4308-9c48-d3bce57c74f3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.136811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:58 2022] PUT /identity/v3/projects/5401064486ed43bab740ef11fb147a85/users/53f94523980e4b8c8b9272803bd96ee5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:00.064980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae39ca-e00f-45d4-b07c-666eb90c9106 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.065444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae39ca-e00f-45d4-b07c-666eb90c9106 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.065525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae39ca-e00f-45d4-b07c-666eb90c9106 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.067322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 100/199] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:00.072395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e3758-b989-4c14-9608-9df632359186 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.072784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e3758-b989-4c14-9608-9df632359186 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.072971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e3758-b989-4c14-9608-9df632359186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.096286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e40e3758-b989-4c14-9608-9df632359186 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:00.097434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e40e3758-b989-4c14-9608-9df632359186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:00.162334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:00.184764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae39ca-e00f-45d4-b07c-666eb90c9106 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.196317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae39ca-e00f-45d4-b07c-666eb90c9106 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.200017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.200725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.201013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.201293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.213371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:00.219663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:28:00.220716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:00.225967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e3758-b989-4c14-9608-9df632359186 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.235063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e3758-b989-4c14-9608-9df632359186 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.239013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.239557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.239845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.240124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.240833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:00.241130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:00.266142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.275553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.280650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.289872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d4b0-a158-4501-bfde-63c84629f70d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.293638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.294414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.294730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.295011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.296355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:00.322612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.324054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.329082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.338056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf132a-593e-4c6e-9fa2-a23d8b7a9a97 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.341931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.342491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.342824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.343107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.350526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:00.376381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.385141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 102/204] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:00.390057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.399647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7a54-9208-4578-9e89-31786dddb67f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.403430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.404183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.404466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.404745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.405780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:00.431722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c058d9e-bbbb-4a1c-b3ec-119b1ecd61bd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.433190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.438445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.447251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2457e-3b59-4bd8-9780-122f6ca03ec1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.451081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.451641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.451929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.452208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.452970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=53f94523980e4b8c8b9272803bd96ee5) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:00.453271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:00.478471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdad88-587d-4e71-93a7-89a3a83b3775 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.484033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 103/206] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/role_assignments?user.id=53f94523980e4b8c8b9272803bd96ee5&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:02.489310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97143cf-f09d-40da-9a2b-8f132b5cdc3e None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.489859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97143cf-f09d-40da-9a2b-8f132b5cdc3e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.489859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97143cf-f09d-40da-9a2b-8f132b5cdc3e None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.491635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 104/207] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:02.496805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.497203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.497375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.519352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:02.520495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:02.527888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 104/208] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:02.550617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97143cf-f09d-40da-9a2b-8f132b5cdc3e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.562412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97143cf-f09d-40da-9a2b-8f132b5cdc3e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.566192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.566950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.567245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.567531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.578906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:02.586182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:02.587714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 105/209] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:02.592867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.601171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9ce2-ed1e-46ed-8b80-cf24d0c0dbde None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.606064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.606647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.606967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.607247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.607953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:02.608251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:02.633202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:02.641372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 105/210] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:02.646320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.657554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ca3f-6237-40b9-a02f-1b015553c123 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.661404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.662175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.662464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.662778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.663931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:02.690629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:02.692093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 106/211] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:02.697025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.705859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103c0b-ba6a-43aa-b32b-1ffe39a43556 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.709623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.710175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.710462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.711275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.718647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:02.744612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:02.753064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:02.758936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.768206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f69df-9bf8-4411-89a4-6b0deeae3af0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.772059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.772832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.773117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.773986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.775080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:02.800206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8363925-0de9-4066-926d-1fd8fd74a753 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:02.801709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 107/213] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:02.807420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:02.815793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c4be9-ef29-4a1a-9207-7c6a25f5b30c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:02.819623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:02.820816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:02.821190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:02.821522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:02.822293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=f331d7ea66b64ecf88c0a3742b8c00a0) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:02.822595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:02.848688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df08b9-cc54-4581-a6e0-28be77c405b9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:02.853954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:02 2022] GET /identity/v3/role_assignments?user.id=f331d7ea66b64ecf88c0a3742b8c00a0&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:04.776941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c065710-bf69-47a2-8732-a2f330ecaf37 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.777457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c065710-bf69-47a2-8732-a2f330ecaf37 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.777567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c065710-bf69-47a2-8732-a2f330ecaf37 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.779205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 108/215] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:04.784439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.784850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.785001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.808005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:04.809136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:04.815670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 108/216] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:04.836953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c065710-bf69-47a2-8732-a2f330ecaf37 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:04.848287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c065710-bf69-47a2-8732-a2f330ecaf37 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:04.852760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:04.853476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.853761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.854039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.864871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:04.871780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:04.872829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:04.878046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:04.886478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048341-ff31-43fa-ac19-6551b49eccb8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:04.890350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:04.890966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.891252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.891530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.892234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:04.892532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:04.918784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:04.926917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 109/218] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:04.931932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:04.941726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28962-b518-4417-846f-b8939165ef63 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:04.945596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:04.946367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.946654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.946964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.948035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:04.973736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:04.975214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 110/219] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:28:04 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:04.980911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:04.990228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76f8fe-6a07-46ee-994f-defae124d55a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:04.994308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:04.995133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:04.995428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:04.995713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:04.996792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:05.022990 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb88d14-091d-40e6-9ba7-38dba5df9830 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.025419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 110/220] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:04 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:05.030624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.039822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf2a80-07d0-4c21-87fd-0b66fd46da6d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.043628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.044427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.044713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.044990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85/users/f331d7ea66b64ecf88c0a3742b8c00a0/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.046920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5401064486ed43bab740ef11fb147a85, user_id=f331d7ea66b64ecf88c0a3742b8c00a0, role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:05.073207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b418f6-03d6-4c5b-8d1f-70b7418d45bb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.084783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 111/221] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:05 2022] PUT /identity/v3/projects/5401064486ed43bab740ef11fb147a85/users/f331d7ea66b64ecf88c0a3742b8c00a0/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:07.035810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a1c7-92bf-471a-b31b-dce96dc0cfe5 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.036242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a1c7-92bf-471a-b31b-dce96dc0cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.036376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a1c7-92bf-471a-b31b-dce96dc0cfe5 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.038066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 111/222] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:07.043854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.044249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.044423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.066408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:07.067566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:07.134154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:07.156638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a1c7-92bf-471a-b31b-dce96dc0cfe5 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.169052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a1c7-92bf-471a-b31b-dce96dc0cfe5 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.172834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.173562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.173850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.174131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.185922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:07.192767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:07.193827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:07.199161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.207424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b69d8-cc85-42aa-a7d8-d0bfba863e80 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.211890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.212472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.212757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.213033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.213744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:07.214041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:07.239597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:07.247807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:07.252942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.262479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd784-8b8a-41bf-8035-bff1d5475d23 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.266441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.267264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.267552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.267834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.268915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:07.295415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:07.296854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:07.301922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.311152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae57b8c-3f4e-4b72-95a3-b1d4798eaf4d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.315251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.315817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.316108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.316390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.324742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:07.355509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:07.364354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 114/227] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:07.370009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.379120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4af23-7571-4d9a-90f6-c2560a8ba2f9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.383744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.384521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.384809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.385087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.386153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:07.412657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e7aa-f4d4-4319-b1e9-f72b52d847e3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:07.414284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 114/228] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:07.419635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:07.427820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109667c3-60e2-4543-83fe-e29363a5bc47 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:07.431725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:07.432290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:07.432581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:07.432861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:07.433631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=5401064486ed43bab740ef11fb147a85, user.id=f331d7ea66b64ecf88c0a3742b8c00a0) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:07.433935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:07.459528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a78f-dda4-4157-9559-64f9b1d4556b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:07.465732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 115/229] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:07 2022] GET /identity/v3/role_assignments?user.id=f331d7ea66b64ecf88c0a3742b8c00a0&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:09.438995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1b0c-6b61-4c77-9db8-52e7be6d4a3f None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:09.439507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1b0c-6b61-4c77-9db8-52e7be6d4a3f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:09.439609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1b0c-6b61-4c77-9db8-52e7be6d4a3f None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:09.441207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 115/230] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:09.447075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:09.447449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:09.447642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:09.469576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:09.470732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:09.477336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 116/231] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:09.499148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1b0c-6b61-4c77-9db8-52e7be6d4a3f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:09.511148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1b0c-6b61-4c77-9db8-52e7be6d4a3f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:09.514896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:09.515602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:09.515889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:09.516168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:09.517205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:09.543104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85271-5bdd-4cb0-83fb-ed0e66b2a48c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:09.544534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 116/232] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:09.549669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:09.558874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36acff-f488-4a0b-843c-b6996e8c4c5f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:09.562765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:09.563346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:09.563636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:09.563918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] PATH_INFO: `/v3/groups` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:09.564539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:09.588852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:09.588852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:09.588852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:09.590015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4952e8-3a14-4d7a-b247-631b0ff7144e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:09.604057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 117/233] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:28:09 2022] POST /identity/v3/groups => generated 229 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:11.568186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2c2c-edb9-4144-adc5-d03b87d62e01 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.568760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2c2c-edb9-4144-adc5-d03b87d62e01 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.568760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b2c2c-edb9-4144-adc5-d03b87d62e01 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.571252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 117/234] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:11.576895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.577964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.577964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.600701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:11.602509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:11.609361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 118/235] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:11.630308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b2c2c-edb9-4144-adc5-d03b87d62e01 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:11.642146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b2c2c-edb9-4144-adc5-d03b87d62e01 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:11.646022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:11.646765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.647058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.647338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.649211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:11.676782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796dd9-118e-4a6b-b643-6a460fd28ba9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:11.678274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 118/236] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:11.684307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:11.693307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f0d6a-95a2-44e4-8f7e-68e07fd89b14 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:11.697415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:11.698005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.698291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.698569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] PATH_INFO: `/v3/groups` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.699230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:11.725531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0adfad-2e13-4b5e-9546-e7a9f9c1f7db admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:11.740464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 119/237] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:28:11 2022] POST /identity/v3/groups => generated 226 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:13.793017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24cfd-2a3c-4a5f-9c01-f332df19a5b1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.793576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24cfd-2a3c-4a5f-9c01-f332df19a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.793576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb24cfd-2a3c-4a5f-9c01-f332df19a5b1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.795283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 119/238] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:13.800392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.800757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.800960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.822810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:13.823930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:13.830424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 120/239] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:13.853212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb24cfd-2a3c-4a5f-9c01-f332df19a5b1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.864525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb24cfd-2a3c-4a5f-9c01-f332df19a5b1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.868367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.869081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.869370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.869650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.881312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:13.887760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:13.888820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:13.894072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.903134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ff6a5-90c1-48c8-a442-5579886029dd None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.906990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.907571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.907858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.908137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.908840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:13.909137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:13.934840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.943217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:13.948501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.957493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5a87f-f17d-43ca-aff5-452b90878c35 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.961833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.962399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.962705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.962988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.970325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:13.996033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.004493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 121/242] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:14.013177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:14.019712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746954-cabe-4bd4-a63c-eb225b85a137 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:14.024547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:14.025327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:14.025615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:14.025894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:14.026993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:14.052342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.053795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 122/243] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:14 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:14.059304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:14.067828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bfa50-f228-4f3b-af31-a1710a15c6d7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:14.072226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:14.073000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:14.073291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:14.073572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:14.078270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:14.103314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:14.103314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:28:14.103314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:28:14.104466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce39ed-71b0-45a7-acfb-0efd531c06b1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.105906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 122/244] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:14 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:14.111500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:14.120721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e03fd-f1fd-448f-a802-37cc4e6b93f7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:14.124548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:14.125118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:14.125404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:14.125685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:14.126451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=29d45dc2a84042c5837937965c286615, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:14.126782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:14.153648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff587631-755b-45d3-aea8-0f50b7de2e7f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.158885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 123/245] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:14 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=29d45dc2a84042c5837937965c286615 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.083725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d5af-4149-4aff-b5cd-d30c0284c659 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.084236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d5af-4149-4aff-b5cd-d30c0284c659 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.084328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d5af-4149-4aff-b5cd-d30c0284c659 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.086106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 123/246] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:16.091202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.091618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.091774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.113609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:16.114776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:16.121822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 124/247] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:16.144090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d5af-4149-4aff-b5cd-d30c0284c659 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.155750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7d5af-4149-4aff-b5cd-d30c0284c659 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.159533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.160242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.160531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.160811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.171685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:16.178042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:16.179712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 124/248] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:16.185137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.193424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88042b8-4b3e-4fa1-9955-7beb82f3ef47 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.198086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.198685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.198988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.199271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.199979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:16.200276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:16.225183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.233500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:16.238715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.249095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-c3db-46f8-8bc6-210acb5af57b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.252961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.253721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.254015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.254295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.255369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:16.280947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.282366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.287262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.296638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1a60-25af-4b3d-9241-158424ad263f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.300447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.301205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.301492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.301772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.302846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:16.328801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28d22e-70c9-45f7-8a6e-e5a6f3a5ed14 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.330270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 126/251] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.335924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.344919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cac06-2b78-42a6-9105-5e4fbf81f4fd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.348866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.349657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.349945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.350228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/groups/d0e94851b47b4620af24a34761e5a295/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.352020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b9f8cc5db14331a52eb044c4aab7f7, group_id=d0e94851b47b4620af24a34761e5a295, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:16.378064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1211e-1383-4adb-9a67-d836d337402f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.390423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 126/252] 10.222.0.48 () {58 vars in 1463 bytes} [Fri Apr 8 02:28:16 2022] PUT /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/groups/d0e94851b47b4620af24a34761e5a295/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:28:18.338811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064725e-10a2-41f1-b430-521a7afa7745 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.339321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064725e-10a2-41f1-b430-521a7afa7745 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.339321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064725e-10a2-41f1-b430-521a7afa7745 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.341000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 127/253] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:18.345957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.346339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.346525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.369077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:18.370226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:18.433913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 127/254] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:18.461153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064725e-10a2-41f1-b430-521a7afa7745 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.472512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064725e-10a2-41f1-b430-521a7afa7745 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.477412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.478137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.478429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.478746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.492026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:18.498382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:18.499490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 128/255] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:18.505056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.514021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d3ad-29f7-44e5-bd53-012169e1855b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.517902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.518489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.518817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.519101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.519808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:18.520107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:18.545963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.554322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 128/256] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:18.559567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.568646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd649271-cf50-4aa5-be9b-7920387341d7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.573042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.573602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.573890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.574170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.581684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:18.607698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.615903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 129/257] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:18.620985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.629806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667ac2f-69c4-45b2-8630-c0d57151eea3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.634224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.635025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.635315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.635596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.636656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:18.662109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.664342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 129/258] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:18.669376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.677567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256405bf-bf18-4e59-899a-348aca684cf3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.682109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.682902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.683192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.683474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.684511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:18.708601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:18.708601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:18.708601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:18.709755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9835d-2665-4a19-beb4-51545a8fa1f7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.711317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 130/259] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:18.716362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.725186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b96f4-fcae-4c1c-ae82-4fa7e212c5ea admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.729542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.730092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.730384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.730693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.731454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=29d45dc2a84042c5837937965c286615, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:18.731762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:18.757975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e273e-31d3-4e0d-8d4a-a0a0c3940f35 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.763583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 130/260] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=29d45dc2a84042c5837937965c286615 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:20.786928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165eda0-91fc-4f53-b534-24a9d8c1594e None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:20.787476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165eda0-91fc-4f53-b534-24a9d8c1594e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:20.787476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165eda0-91fc-4f53-b534-24a9d8c1594e None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:20.789675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 131/261] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:20.794765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:20.795146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:20.795342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:20.817944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:20.819111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:20.825666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 131/262] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:20.847137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165eda0-91fc-4f53-b534-24a9d8c1594e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:20.858975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165eda0-91fc-4f53-b534-24a9d8c1594e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:20.862784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:20.863500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:20.863788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:20.864067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:20.878494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:20.886201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:20.887334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 132/263] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:20.893447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:20.902990 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446865-8243-4949-a472-2a951617f1a8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:20.906953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:20.907574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:20.907866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:20.908204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:20.908922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:20.909224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:20.934408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:20.942928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 132/264] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:20.949432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:20.959738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3a16-0b61-43dd-944c-3068efd029c2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:20.964847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:20.965417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:20.965709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:20.965995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:20.973589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:20.999605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.009049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 133/265] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:20 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:21.014605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.024591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b70ea-f74c-442a-b8fa-1ed623d364b4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.028506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.029291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.029582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.029867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.030971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:21.056592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.058060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 133/266] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:21 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:21.063122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.072222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc23c-392b-42ed-8364-d8f9054c3a9a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.076613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.077514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.077887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.078267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.079461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:21.105409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec70f-ca5c-48b9-818c-dc611fef8f3e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.106998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 134/267] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:21 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:21.112393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.121937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486a2db-a744-4c96-a3bf-af3cce8f8c73 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.125816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.126389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.126704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.126994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.127763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:21.128069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:21.154117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0562f8c-5fb8-4139-a69a-f7c409889080 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.159373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:21 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:23.076253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12ead-437c-4f37-ae14-9df306c17484 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.076748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12ead-437c-4f37-ae14-9df306c17484 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.076853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12ead-437c-4f37-ae14-9df306c17484 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.078485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 135/269] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:23.083394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.083807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.083961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.107873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:23.108999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:23.115487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 135/270] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:23.136884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12ead-437c-4f37-ae14-9df306c17484 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.149336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12ead-437c-4f37-ae14-9df306c17484 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.153079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.153824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.154109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.154384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.165301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:23.171994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:23.173043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 136/271] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:23.178278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.186834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f894a-a77d-4079-a941-ff4057681dd3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.190720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.191310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.191597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.191875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.192590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:23.192888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:23.218707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:23.227457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 136/272] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:23.232508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.243025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7033c-62a6-4aae-a38a-48922c718144 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.246765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.247518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.247804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.248080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.249104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:23.274264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:23.275689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 137/273] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:23.280673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.290096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3f7d-97af-4e7f-8885-0d65c79441bb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.293912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.294700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.294995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.295276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.296332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:23.322111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360137b5-2f40-49a3-8f3c-07538ad8ede0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:23.323612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 137/274] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:23.328637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.337602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ece86-cca2-4e25-b0d4-9c5fa426005f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.341371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.342246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.342571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.342993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/groups/d0e94851b47b4620af24a34761e5a295/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.344894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b9f8cc5db14331a52eb044c4aab7f7, group_id=d0e94851b47b4620af24a34761e5a295, role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:23.371969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29d12c-543d-4c16-852b-a8b34b722455 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:23.383614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 138/275] 10.222.0.48 () {58 vars in 1463 bytes} [Fri Apr 8 02:28:23 2022] PUT /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7/groups/d0e94851b47b4620af24a34761e5a295/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:25.324255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c647a-2825-45e1-a244-2919aa6d3e57 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.324773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c647a-2825-45e1-a244-2919aa6d3e57 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.324773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c647a-2825-45e1-a244-2919aa6d3e57 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.326408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 138/276] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:25.331520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.331888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.332094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.354835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:25.355975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:25.419881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 139/277] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:25.442223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c647a-2825-45e1-a244-2919aa6d3e57 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.454047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c647a-2825-45e1-a244-2919aa6d3e57 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.457833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.458555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.458871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.459153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.471331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:25.478257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:25.479343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 139/278] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:25.484809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.493226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3cf29-f6aa-43a6-a101-7edaef5ca347 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.497087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.497672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.497962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.498243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.498993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:25.499293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:25.525084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:25.533231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 140/279] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:25.539406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.548400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb6178-b557-4302-914d-3230c8b14733 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.552208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.552768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.553055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.553334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.561368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:25.586762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:25.594869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 140/280] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:25.599945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.609362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bc46a-d9e9-49dd-9a94-e47ed3872da7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.613141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.613908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.614195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.614473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.615562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:25.641541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:25.643046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 141/281] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:25.648400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.656865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457e6a-048f-4d40-a294-01a0116045ac admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.660633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.661390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.661674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.661952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.663257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:25.688942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89a045-6079-4c61-81e0-6efd1f048b6e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:25.690390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 141/282] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:25.696408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:25.705628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96bb83-12cb-4d23-9458-dc2a3eb7a4eb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:25.709402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:25.710274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:25.710811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:25.711234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:25.712012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:25.712317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:25.737779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44290536-5d80-4496-81f2-c2eb7ea13957 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:25.744307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 142/283] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:25 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:27.676224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a3e9-57fb-42ee-ad71-7c094b3e5658 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.676750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a3e9-57fb-42ee-ad71-7c094b3e5658 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.676861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738a3e9-57fb-42ee-ad71-7c094b3e5658 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.678442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 142/284] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:27.683625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.684154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.684263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.706785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:27.707917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:27.715156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 143/285] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:27.736434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738a3e9-57fb-42ee-ad71-7c094b3e5658 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.747849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738a3e9-57fb-42ee-ad71-7c094b3e5658 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.751571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.752279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.752564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.752841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.764277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:27.770556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:27.771624 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 143/286] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:27.777770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.786132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b72b-c780-4f98-a3de-d25be3e99012 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.790105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.790720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.791009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.791285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.791989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:27.792284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:27.817307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.826206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 144/287] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:27.831358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.841898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2664c0-75c3-46d4-a8c8-91b06b4feb7c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.845713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.846271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.846556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.846872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.854332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:27.879827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.888719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:27.893769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.903023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2aed3-c2f3-4c6a-ae58-fdc4291dc19b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.906801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.907566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.907851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.908125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.909172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:27.935102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.936512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:27.941298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.950257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596656b-a4c3-48ae-bdd8-50eda71be09e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.954078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.954867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.955155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.955434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.956480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:27.981862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8f267-14d8-470b-bee5-48ee0d561afc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.983331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 145/290] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:27.988719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.998491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897214e-7177-4adb-8d51-7536a0b8772c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:28.002299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:28.002899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:28.003188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:28.003463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:28.004232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=29d45dc2a84042c5837937965c286615, scope.project.id=5401064486ed43bab740ef11fb147a85) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:28.004530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:28.030817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed64cb1-67c8-489e-95e5-ad88dbc71a31 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:28.036113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 146/291] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=29d45dc2a84042c5837937965c286615 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:29.962491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ac27-b305-49a5-90d5-188ff3773aa8 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.963067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ac27-b305-49a5-90d5-188ff3773aa8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.963067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ac27-b305-49a5-90d5-188ff3773aa8 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.964754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 146/292] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:29.969812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.970211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.970381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.992472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:29.993618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:30.000204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 147/293] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:30.022188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ac27-b305-49a5-90d5-188ff3773aa8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:30.034617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ac27-b305-49a5-90d5-188ff3773aa8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:30.038585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:30.039337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:30.039630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:30.039914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:30.050874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:30.057391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:30.058455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 147/294] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:30.063894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:30.073030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073ab1b-c6ea-4221-bef4-f792d86d5ecf None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:30.076881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:30.077465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:30.077751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:30.078029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:30.078773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:30.079073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:30.105027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:30.113438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 148/295] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:30.119534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:30.129526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd45f1-e9ee-48c2-82de-c177f3798e2b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:30.133983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:30.134797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:30.135090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:30.135371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:30.136436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:30.161911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:30.163510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 148/296] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:30 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:30.169508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:30.178965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc6fcd-e989-4ffd-910c-a36b88bc46b7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:30.182964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:30.183743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:30.184038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:30.184319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:30.185382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:30.211532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211eb7d-f4cd-48d1-8dca-7a7facbd1347 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:30.213100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 149/297] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:30 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:30.218273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:30.227589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8399fb-6933-4874-ab2c-2dd717ef3913 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:30.231429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:30.232221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:30.232508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:30.232788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85/groups/d0e94851b47b4620af24a34761e5a295/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:30.234493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5401064486ed43bab740ef11fb147a85, group_id=d0e94851b47b4620af24a34761e5a295, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:30.261418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0c0e3-7fb3-4bcd-a52a-ef46797e7dd1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:30.273078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1463 bytes} [Fri Apr 8 02:28:30 2022] PUT /identity/v3/projects/5401064486ed43bab740ef11fb147a85/groups/d0e94851b47b4620af24a34761e5a295/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:32.200678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34d78-49e2-4303-9578-99b1fc5ca59e None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.201190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34d78-49e2-4303-9578-99b1fc5ca59e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.201275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34d78-49e2-4303-9578-99b1fc5ca59e None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.202952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 150/299] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:32.207947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.208311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.208513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.231394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:32.232525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:32.296010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 150/300] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:32.317868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34d78-49e2-4303-9578-99b1fc5ca59e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.330018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa34d78-49e2-4303-9578-99b1fc5ca59e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.333832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.334561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.335604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.335888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.347613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:32.354064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:28:32.355163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 151/301] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:32.360612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.369658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a056b-9e56-423a-9c4f-1907a51cbdab None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.373682 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.374272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.374563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.374896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.375635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:32.375935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:32.401742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.410100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 151/302] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:32.415500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.424516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446cec7-a153-45aa-89c4-0b21a79e3c29 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.428883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.429583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.429874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.430159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.437643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:32.463231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.471476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 152/303] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:32.476615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.485542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99800a8-b09f-4d08-8cf7-7ccb9d6ecf78 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.489301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.490069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.490357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.490639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.492283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:32.518043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.519540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 152/304] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:32.524668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.532904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726ce4-426a-4017-934e-d82a66d491cf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.536744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.537504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.537870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.538297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.539361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:32.565251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a5461-3fe6-445b-b8a8-7c8128be3391 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.566621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 153/305] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:32.571874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.580700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997132d-e144-44a9-9819-f366b2aa5af8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.585026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.585888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.586181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.586461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.587247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=29d45dc2a84042c5837937965c286615, scope.project.id=5401064486ed43bab740ef11fb147a85) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:32.587550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:32.613271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845d9dc-1191-493e-97a9-a19625896c81 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.619065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 153/306] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=29d45dc2a84042c5837937965c286615 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.559337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf069c-e154-4be7-9dcd-f0b58244d0a7 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.559860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf069c-e154-4be7-9dcd-f0b58244d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.559951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf069c-e154-4be7-9dcd-f0b58244d0a7 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.561577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 154/307] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:34.566456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.566863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.567055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.590021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:34.591184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:34.597582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 154/308] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:34.619545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf069c-e154-4be7-9dcd-f0b58244d0a7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.630759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf069c-e154-4be7-9dcd-f0b58244d0a7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.635130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.635848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.636139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.636420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.647619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:34.654709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:34.655788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 155/309] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:34.660989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.669362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afd3f-7ac4-4459-bb78-d78d10bbe35d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.673188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.673767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.674057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.674336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.675079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:34.675377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:34.700762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.708845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 155/310] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.714336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.724228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26380909-05d9-4d64-b660-2d4c9c6ce999 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.728227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.728782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.729072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.729354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.736823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:34.762976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.771172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 156/311] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:28:34.776743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.785565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3cd72-ca9b-4df2-83e4-9f2c11c34fc2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.789472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.790239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.790528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.790847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.791905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:34.817666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.819809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 156/312] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.824713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.832919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a98e14-f293-44d4-90ea-80589a4b60a5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.836796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.837554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.837843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.838123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.839194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:34.864262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85abf6-91ab-47a8-a433-dc65f084f8c7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.865667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 157/313] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.871779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.880798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d458c-925a-4094-ba54-f09e16897b87 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.885744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.886312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.886606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.886934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.887710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=5401064486ed43bab740ef11fb147a85) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:34.888019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:34.914583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fad8ec-d7e1-44f2-9c8f-ad09fc285ae5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.919864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 157/314] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:36.852417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cce7-24ef-47af-9dab-eae9bad325c1 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:36.852973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cce7-24ef-47af-9dab-eae9bad325c1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:36.852973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6cce7-24ef-47af-9dab-eae9bad325c1 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:36.854680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 158/315] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:36.859553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:36.859915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:36.860121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:36.883191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:36.884317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:36.890759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:36.913304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6cce7-24ef-47af-9dab-eae9bad325c1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:36.924702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6cce7-24ef-47af-9dab-eae9bad325c1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:36.928740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:36.929463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:36.929752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:36.930032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:36.940916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:36.947702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:36.948764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:36.953960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:36.963316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b3b4-0518-4a63-9f67-31fb506d4166 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:36.967208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:36.967800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:36.968093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:36.968381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:36.969095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:36.969401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:36.995329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.003835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 159/318] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.009257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.019326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc848fe5-dcc0-4221-944b-d5af2b8ecbb0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.023957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.024718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.025006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.025284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.026329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:37.051988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.053671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 160/319] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.058348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.067310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894f48-c80e-4de6-95d1-411284bea109 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.071242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.072019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.072308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.072590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.073650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:37.099713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c31032-f980-4eb3-a686-9b33638d2447 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.102149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 160/320] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.107343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.116432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b427d-7119-43fd-9607-1fcc797ed234 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.120340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.121130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.121417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.121697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85/groups/d0e94851b47b4620af24a34761e5a295/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.123658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5401064486ed43bab740ef11fb147a85, group_id=d0e94851b47b4620af24a34761e5a295, role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:37.150564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf5211-76ca-43f8-89a5-aef206dd7928 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.162132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 161/321] 10.222.0.48 () {58 vars in 1463 bytes} [Fri Apr 8 02:28:37 2022] PUT /identity/v3/projects/5401064486ed43bab740ef11fb147a85/groups/d0e94851b47b4620af24a34761e5a295/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:39.085020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f6d19-9f97-4322-9e98-02afda6208ca None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.085536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f6d19-9f97-4322-9e98-02afda6208ca None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.085654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f6d19-9f97-4322-9e98-02afda6208ca None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.087904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 161/322] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:39.093055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.093432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.093623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.115425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:39.117029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:39.180790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:39.202115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f6d19-9f97-4322-9e98-02afda6208ca None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.214815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f6d19-9f97-4322-9e98-02afda6208ca None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.218565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.219320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.219613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.219893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.232199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:39.238979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:28:39.239998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 162/324] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:39.245479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.253893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def0ad-7295-43c3-b03a-060131177cb7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.257809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.258391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.258686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.258977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.259690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:39.259987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:39.285594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:39.294335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 163/325] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:39.299424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.308383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25c4a-aaf4-4729-b05c-87fd8a881387 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.312230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.312791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.313080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.313363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.320833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:39.346714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:39.355249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 163/326] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:39.360329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.370409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ff02-816b-4713-b0cc-34d722a9540e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.374422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.375299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.375587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.375868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.376927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:39.402971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:39.404453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 164/327] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:39.409430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.417626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a49d21-1bcc-4adb-bbbe-73a70b01a460 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.421527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.422289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.422576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.422882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] PATH_INFO: `/v3/groups/d0e94851b47b4620af24a34761e5a295` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.423924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] RBAC: Authorizing `identity:get_group(group_id=d0e94851b47b4620af24a34761e5a295)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:39.450360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ddbc6-8f5e-4795-8ed2-77a1bba74eac admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:39.451781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 164/328] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/groups/d0e94851b47b4620af24a34761e5a295 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:39.456929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:39.465809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70049e7a-811c-4941-8c86-acb824e88da1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:39.469667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:39.470227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.470515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.470833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.471607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] RBAC: Adding query filter params (group.id=d0e94851b47b4620af24a34761e5a295, role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=5401064486ed43bab740ef11fb147a85) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:39.471912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:39.497648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3273e3-d6a0-412e-9430-513046a90d13 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:39.503214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 165/329] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:39 2022] GET /identity/v3/role_assignments?group.id=d0e94851b47b4620af24a34761e5a295&scope.project.id=5401064486ed43bab740ef11fb147a85&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:41.449722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafbac-b623-41cb-a0b4-d8a526ea28f9 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.450333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafbac-b623-41cb-a0b4-d8a526ea28f9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.450333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fafbac-b623-41cb-a0b4-d8a526ea28f9 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.451990 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 165/330] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:41.457034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.457409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.457600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.480102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:41.481228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:41.487757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 166/331] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:41.510021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fafbac-b623-41cb-a0b4-d8a526ea28f9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.521367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fafbac-b623-41cb-a0b4-d8a526ea28f9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.525929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.526640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.526971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.527253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.538756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:41.545074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:28:41.546129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:41.551389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.559776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4288d-fccb-4aeb-aa88-a50eaa6bce4f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.563715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.564296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.564588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.564870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.565584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:41.565881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:41.591493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:41.600119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:41.605627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.615740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6654fe3-ef0e-4c86-81da-99cdfb0ac514 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.619589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.620150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.620442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.620725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.628227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:41.653933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:41.662156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 167/334] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:41.667896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.676889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480a2c-1bb1-4dc0-91e1-c53677e2a609 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.681430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.682201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.682491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.682808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.683885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b654bd89267e40c6bd627b095329b06e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:41.710311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:41.711800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 168/335] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/projects/b654bd89267e40c6bd627b095329b06e => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:41.716650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.725471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81b76-2396-48c1-82cd-585f5d368217 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.729344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.730101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.730390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.730690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] PATH_INFO: `/v3/groups/35de3043484a4b3ba92ef54d59d122c3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.736112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=35de3043484a4b3ba92ef54d59d122c3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:41.761858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8d1e-e1ff-4642-8326-4f17c3a1b1b8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:41.763376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 168/336] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/groups/35de3043484a4b3ba92ef54d59d122c3 => generated 229 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:41.768909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:41.783719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672bbdb-afff-4106-80a3-c5fc3e831ca1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:41.788099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:41.788680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:41.788985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:41.789257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:41.790041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] RBAC: Adding query filter params (group.id=35de3043484a4b3ba92ef54d59d122c3, role.id=25829623b314474f90be394caa52cb01, scope.project.id=b654bd89267e40c6bd627b095329b06e) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:41.790349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:41.815967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83244478-032d-4d62-a2a0-e0558080af4c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:41.822279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 169/337] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:41 2022] GET /identity/v3/role_assignments?group.id=35de3043484a4b3ba92ef54d59d122c3&scope.project.id=b654bd89267e40c6bd627b095329b06e&role.id=25829623b314474f90be394caa52cb01 => generated 260 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:43.738095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a43d6-9f41-4abb-bd33-c2f268f0f2e1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.738643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a43d6-9f41-4abb-bd33-c2f268f0f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.738643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a43d6-9f41-4abb-bd33-c2f268f0f2e1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.740862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 169/338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:43.745830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.746258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.746397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.768742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:43.769857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:43.776597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 170/339] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:43.797687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a43d6-9f41-4abb-bd33-c2f268f0f2e1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:43.809820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a43d6-9f41-4abb-bd33-c2f268f0f2e1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:43.813601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:43.814310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.814599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.814930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.826488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:43.832841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:28:43.833911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 170/340] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:43.839453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:43.847835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619e2f-afc0-4e34-88d8-5e684be3f8ca None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:43.851786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:43.852368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.852655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.852932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.853638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:43.853933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:43.879521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:43.888389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 171/341] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:43.893670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:43.904179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a281-e304-4c53-abb6-f53b8f864ddd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:43.908063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:43.908858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.909152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.909435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] PATH_INFO: `/v3/groups/35de3043484a4b3ba92ef54d59d122c3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.910499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] RBAC: Authorizing `identity:get_group(group_id=35de3043484a4b3ba92ef54d59d122c3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:43.936186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:43.937618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 171/342] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:43 2022] GET /identity/v3/groups/35de3043484a4b3ba92ef54d59d122c3 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:43.942457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:43.951968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9040c6-dca2-4f46-b04c-e01b4f59e636 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:43.955759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:43.956532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:43.956819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:43.957096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:43.958144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b654bd89267e40c6bd627b095329b06e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:43.983113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80571f8c-84f5-44e0-a017-315362e8c8c8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:43.984630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 172/343] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:43 2022] GET /identity/v3/projects/b654bd89267e40c6bd627b095329b06e => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:43.989946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:43.999699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa913e7-a7b4-4825-a7bf-490ed22a007a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.003579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.004380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.004673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.004959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e/groups/35de3043484a4b3ba92ef54d59d122c3/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.007549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b654bd89267e40c6bd627b095329b06e, group_id=35de3043484a4b3ba92ef54d59d122c3, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:44.033894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a549a-4ae9-44ca-92e3-2d6a940c98b1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.047155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 172/344] 10.222.0.48 () {58 vars in 1463 bytes} [Fri Apr 8 02:28:43 2022] PUT /identity/v3/projects/b654bd89267e40c6bd627b095329b06e/groups/35de3043484a4b3ba92ef54d59d122c3/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:28:46.059632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cdcc-0d1e-407a-833a-6e5a3bd63226 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.060123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cdcc-0d1e-407a-833a-6e5a3bd63226 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.060219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cdcc-0d1e-407a-833a-6e5a3bd63226 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.061870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 173/345] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:46.066827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.067270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.067395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.091482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:46.092634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:46.156283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 173/346] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:46.178839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cdcc-0d1e-407a-833a-6e5a3bd63226 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.190235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cdcc-0d1e-407a-833a-6e5a3bd63226 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.194641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.195368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.195656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.195935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.207510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:46.214042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:28:46.215137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 174/347] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:46.220360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.228720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b529e1-cc84-458a-b4e1-1c3660b5ab78 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.232612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.233197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.233485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.233765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.234512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:46.234798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:46.260402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.268718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 174/348] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:46.274124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.283140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be016-a6e4-40c6-9fef-abcf47fa5c95 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.286975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.288026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.288313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.288593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.296127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:46.321937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.330204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 175/349] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:46.336586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.345576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160d04-9adc-4334-915e-7c777f4723cf admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.349465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.350740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.351035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.351321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.352408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] RBAC: Authorizing `identity:get_project(project_id=b654bd89267e40c6bd627b095329b06e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:46.378107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.379632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 175/350] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/projects/b654bd89267e40c6bd627b095329b06e => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:46.385000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.393217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d7b22-c026-4de8-b7d2-2bf8eb71accd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.397826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.398872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.399160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.399436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] PATH_INFO: `/v3/groups/35de3043484a4b3ba92ef54d59d122c3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.400477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] RBAC: Authorizing `identity:get_group(group_id=35de3043484a4b3ba92ef54d59d122c3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:46.425911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebf34e-74c1-4813-88ec-7ac03391daca admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.427359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1201 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/groups/35de3043484a4b3ba92ef54d59d122c3 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:46.432900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.441789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b54c-f194-4280-81b9-462dfba3d881 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.446268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.446872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.447167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.447450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.448220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] RBAC: Adding query filter params (group.id=35de3043484a4b3ba92ef54d59d122c3, role.id=25829623b314474f90be394caa52cb01, scope.project.id=b654bd89267e40c6bd627b095329b06e) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:46.448525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:46.474327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f383-a39d-4312-a9fe-ae45b47b6c25 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.479972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1397 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/role_assignments?group.id=35de3043484a4b3ba92ef54d59d122c3&scope.project.id=b654bd89267e40c6bd627b095329b06e&role.id=25829623b314474f90be394caa52cb01 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:48.475422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca56b-ca97-485b-9cb1-60c316c4a54a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:48.475969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca56b-ca97-485b-9cb1-60c316c4a54a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:48.475969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ca56b-ca97-485b-9cb1-60c316c4a54a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:48.477662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 177/353] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:48.482620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:48.483024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:48.483251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:48.505714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:48.507501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:48.514051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 177/354] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:48.538252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca56b-ca97-485b-9cb1-60c316c4a54a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:48.549698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ca56b-ca97-485b-9cb1-60c316c4a54a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:48.554658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:48.555417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:48.555710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:48.555992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:48.567887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:48.593859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:48.611319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:48.612370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 178/355] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:48.618876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:48.627266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633df8-b36a-4a0b-8a5b-e496b08a0834 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:48.631405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:48.631982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:48.632272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:48.632551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:48.633232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:48.633531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:48.658702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9e47-58d2-4e9a-ba37-4b25203eb8c7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:48.671623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 178/356] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:48.676716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:48.686476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3c73-b716-4ed3-801f-0818568bc1d7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:48.690328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:48.690947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:48.691238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:48.691518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:48.692154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:48.716791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:48.716791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:48.716791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:48.717985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48e8d2-1740-4517-b742-3e0bcbf24f86 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:48.742156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 179/357] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:28:48 2022] POST /identity/v3/users => generated 246 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:50.719961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8784d-5948-4307-a0e2-b250137f28e4 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.720479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8784d-5948-4307-a0e2-b250137f28e4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.720569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8784d-5948-4307-a0e2-b250137f28e4 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.722191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 179/358] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:50.727633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.728032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.728203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.750355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:50.751504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:50.758769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 180/359] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:50.780391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8784d-5948-4307-a0e2-b250137f28e4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:50.792896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8784d-5948-4307-a0e2-b250137f28e4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:50.796714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:50.797432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.797724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.798010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.810024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:50.816527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:50.817600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:50.823308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:50.831838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400be75-bd72-4c14-9a81-cf8227ec4493 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:50.835824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:50.836414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.836705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.836989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.837711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:50.838014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:50.863529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:50.872369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 181/361] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:50.877610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:50.887207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4198c-2975-41ad-b95d-766136ae3de1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:50.891088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:50.891786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.892073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.892355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.903555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:50.930194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:50.947697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:50.948774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 181/362] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:50.953984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:50.963085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5fe2-0afa-47c8-81d1-73ef662b64bf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:50.966898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:50.967473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:50.967760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:50.968041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:50.968719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:50.969015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:50.994502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:50.994502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:50.994502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:50.995401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.008324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 182/363] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:51.013535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.022743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856c1b-162b-4ed1-aacd-26b11ddfa77e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.026831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.027539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.027829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.028107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.041057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.067224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.085475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:51.086634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 182/364] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:51.092479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.102287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2128044-57f3-408a-a573-9fda8b642bfe admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.106112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.106726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.107016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.107296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.108079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:51.108378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.137136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:51.137136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:51.137136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:51.138268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.168600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 183/365] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:51.174148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.183442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf1300-b104-4712-b172-1bd398981e43 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.187220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.187780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.188069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.188349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.195743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.221302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.230046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 183/366] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:51.235142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.244357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ac77-b855-422f-b4f6-d67fe6d60533 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.248164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.248868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.249162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.249442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.260722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.286502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.303545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:51.304581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 184/367] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:51.309668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.318020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897acdf4-f0a9-437a-b363-c8073fcb0014 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.322047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.322622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.322942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.323226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.323904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:51.324204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.350157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.362792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 184/368] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:51.367829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.376766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814632a1-0a72-45ed-8b05-554c7ca3e6bf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.380579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.382165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.382470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.382771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.393884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.420564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.434378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:51.435574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:51.441294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.450560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a824968-85a3-46e9-ae69-6edbd1ccfdf1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.454360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.454969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.455260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.455539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.456274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:51.456575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.482254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:51.482254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:28:51.482254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:28:51.483386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b604-0d40-4b4e-b52b-8f5cb1a22826 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.496343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 185/370] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:51.501720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.511423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91ec2a-582e-4f7b-88b0-1f1cfc3bb514 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.515209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.515775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.516060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.516335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.517104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:51.517410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:51.543572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08742943-0f91-4a64-b7aa-ba47bcf33406 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.548729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 186/371] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:53.475390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12c8a-7df8-4411-8590-b2364c43d0b8 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.475919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12c8a-7df8-4411-8590-b2364c43d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.476009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d12c8a-7df8-4411-8590-b2364c43d0b8 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.477603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 186/372] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:53.482658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.483069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.483248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.580877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:53.582016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:53.588568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 187/373] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:53.609553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d12c8a-7df8-4411-8590-b2364c43d0b8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.621530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d12c8a-7df8-4411-8590-b2364c43d0b8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.625324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.626039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.626329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.626611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.638041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:53.644541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:53.645598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 187/374] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:53.651286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.659557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1265436-9ac5-4e93-98b0-81de8b804b00 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.663445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.664022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.664307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.664583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.665288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:53.665583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:53.690938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.699859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:53.704918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.714393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352462b-619a-4a2a-b4f4-59b9990fa625 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.718243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.718974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.719267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.719548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.730505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:53.757012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.774518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:53.775587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 188/376] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:53.780710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.790101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbfb94-cfcf-4ac8-8c0a-4a30d11eef57 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.793886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.794452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.794854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.795134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.795808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:53.796106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:53.821681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.834291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 189/377] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:53.839578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.848799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1f193-ee68-4483-8c3a-a16dfb47b53c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.853497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.854200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.854489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.854800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.869293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:53.894762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.912545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:53.913761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 189/378] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:53.919162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.929171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7f32-ae86-4f09-a7ba-ac972d92733a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.933084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.933669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.933958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.934241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.935064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:53.935366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:53.960636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.989185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 190/379] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:53.995124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.004250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15853249-3207-417f-bff7-127db2b161a1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.008238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.008950 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.009238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.009520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.095993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:54.122234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.139628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:54.140699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 190/380] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:54.146728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.156654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd0386-70e8-44e2-ab03-898c92edc464 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.160584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.161177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.161471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.161760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.163614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:54.163921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:54.189343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.201610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 191/381] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:54.206636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.216137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2cc4-de67-414e-a916-eff6360aabc2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.219993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.220689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.220974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.221253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.230476 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:54.256512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.269610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:54.270632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 191/382] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:54.276652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.285659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34452b5-dc7d-44bd-b13b-00292f8e7c56 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.290283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.290886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.291178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.291460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.292196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:54.292496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:54.317156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:54.317156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:28:54.317156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:28:54.318415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1cacb-0265-43eb-99c7-cf3d56ad57a0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.331361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 192/383] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:54.337366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.346298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6db5b1-5103-4709-806e-c85334f59a83 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.350827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.351622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.351908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.352187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.372465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=2e40067b250f40d997dad1817ccbbba6, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:54.399101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39a379-6b09-40e6-a480-2aa44e6b1fc3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.410646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 192/384] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:54 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:56.337960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21e8b-0fa1-4955-8266-aafc2920137a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.338475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21e8b-0fa1-4955-8266-aafc2920137a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.338475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21e8b-0fa1-4955-8266-aafc2920137a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.340178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 193/385] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:56.345038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.345445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.345604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.368691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:56.369832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:56.432693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 193/386] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:56.453570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21e8b-0fa1-4955-8266-aafc2920137a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.465389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21e8b-0fa1-4955-8266-aafc2920137a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.469198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.469908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.470196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.470474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.482004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:56.488415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:56.489458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 194/387] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.494913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.503357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332a3f-f77d-4ec0-a530-aa0ea12ea71f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.507477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.508062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.508352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.508634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.509341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:56.509642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.535324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.544152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 194/388] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.549231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.558829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053fd78-1796-4f5c-8712-42e0b0eb2c70 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.562724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.563419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.563707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.563987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.574915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.601469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.618776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:56.619819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 195/389] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.625010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.634062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1351-cda2-4336-a6ab-908a454f56e8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.637947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.638518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.638840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.639127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.639806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:56.640114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.665792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.678642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 195/390] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.683645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.692564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b01-89fa-4090-929b-2efd26e54219 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.697109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.697797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.698085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.698367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.711166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.737048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.754293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:56.755343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 196/391] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:56.761161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.770121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c8d2-841a-41e8-b1c7-fbbcaa370145 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.774895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.775476 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.775768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.776051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.776832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:56.777135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.801518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:56.801518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:28:56.801518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:28:56.802622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.831657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.837375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.846303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1070be-738d-41ce-90cf-f442f1695896 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.850175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.850762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.851058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.851336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.858748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.884394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.892563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 197/393] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:56.898508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.907569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103daae-0509-4cd4-baca-b8a780402eb3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.912066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.912988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.913279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.913560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.925036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:56.950821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.968017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:56.969101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.974503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.983204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c456b-1bf4-4279-82f8-f4c9464d223b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.987188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.987854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.988112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.988396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.989083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:56.989379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:57.015038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:57.028586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:57.034026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:57.043093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24f90-2b81-4db3-9495-dcf276284766 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:57.046943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:57.047646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:57.047934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:57.048214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:57.058612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:57.085066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:57.098361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:57.099450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:57.104764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:57.113808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958472-837c-459f-a6e5-3ad9dbc4ed11 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:57.118283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:57.118881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:57.119170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:57.119450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:57.120183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:57.120484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:57.146832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf62f0-3eec-4fcc-9965-68bca44d90cd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:57.159546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:57.165625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:57.174554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e2ea-a8af-48a2-981c-c5545d319d85 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:57.178451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:57.179046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:57.179339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:57.179622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:57.180389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:57.180695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:57.205903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05fd3b-5b43-4d5d-8396-610e4029ca8d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:57.212037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 199/398] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:57 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.193514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0057e-f369-4902-8db0-7f05d3d70e4a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.194084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0057e-f369-4902-8db0-7f05d3d70e4a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.194084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0057e-f369-4902-8db0-7f05d3d70e4a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.195798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 200/399] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:59.200688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.201112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.201270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.224131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:59.225272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:59.231912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 200/400] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:59.254022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0057e-f369-4902-8db0-7f05d3d70e4a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.266345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0057e-f369-4902-8db0-7f05d3d70e4a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.270164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.270911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.271934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.272220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.283491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:28:59.290052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:28:59.291168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 201/401] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.296535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.304954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec98d2-bbf4-4750-af62-f42e01c6c548 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.308901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.309488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.309781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.310066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.310807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.311112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.336598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.344960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 201/402] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.350464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.359858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb464cd4-efdd-43ab-be3a-be83ddbd776f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.363749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.364439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.365291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.365653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.376524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.402685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.421512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:59.422539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 202/403] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.427776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.436778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdec-2fd5-447a-8551-4a9780863abc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.440628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.441203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.441492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.441773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.442449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.442782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.468188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.481179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 202/404] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.486095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.495213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f5051-5ca1-40f3-98fe-b304f69956b3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.499091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.499785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.500073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.500352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.512905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.539409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.556459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:59.557652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 203/405] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.562866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.571802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b62650-7377-43ab-85c3-658e42644917 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.575637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.576213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.576498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.576774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.577545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.577843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.603878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.632392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 203/406] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.637486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.647524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc83b2-d886-4193-97c0-55e65d27f5b7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.651775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.652337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.652627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.652907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.660364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.686916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.695641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 204/407] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:59.700806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.710745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4298aaf-93fa-46b8-b655-dea99a8b89f1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.714552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.715287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.715575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.715854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.727585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.752723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.769516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:59.770510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 204/408] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.776619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.785088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee079b3-95cb-4efa-8053-bfd573471d5a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.789599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.790182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.790473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.790784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.791471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.791772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.817239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.830765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 205/409] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.836305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.845379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df2eec-2bed-47e3-82ae-8335c6ef3d45 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.849271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.850142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.850431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.850740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.859406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.885196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.899402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:59.900456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 205/410] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.905824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.914923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19535f8-9db9-446c-8c2e-8365f20115c1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.918776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.919350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.919636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.919911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.920645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.920943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:28:59.946677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355e7a7-fa40-4957-9d07-dffa30128c98 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.960213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 206/411] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.965592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.974705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4396628-1633-40c4-a3a8-39947c083ced admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.978556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.979231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.979581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.979923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.980753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:28:59.981118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:00.007423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b140363-4086-4368-bfec-5fd574dc1d40 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:00.013258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 206/412] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:01.963601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cee10-b645-45c9-aeb7-fdd9fc834863 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.964146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cee10-b645-45c9-aeb7-fdd9fc834863 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.964146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cee10-b645-45c9-aeb7-fdd9fc834863 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.965825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 207/413] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:01.970892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.971268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.971472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.994291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:01.995474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:02.002128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 207/414] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:02.024198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cee10-b645-45c9-aeb7-fdd9fc834863 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.035532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cee10-b645-45c9-aeb7-fdd9fc834863 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.040151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.040852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.041138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.041412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.053091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:02.059377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:29:02.060430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 208/415] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:02.065672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.074323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc927c-7536-454c-8bf2-afdf5f9cb74d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.078269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.078892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.079184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.079464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.080173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:02.080477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.105911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.114268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 208/416] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:02.119887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.129497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485791-c5e0-4b7a-ae33-d9c26a34ab3b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.133980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.134685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.134986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.135262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.146805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.172113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.189035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:02.190063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 209/417] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:02.195773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.204781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab6eb-7265-4afd-8bfd-495271fa6f52 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.209238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.209816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.210106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.210387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.211101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:02.211402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.236178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.248614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 209/418] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:02.253571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.263148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6fde-8e7f-4313-9ba9-a04700e1a048 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.267035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.267726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.268015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.268297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.281406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.306913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.324590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:29:02.325648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:02.330918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.340266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4999e-2ba0-4b3e-8896-915949123d7d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.344133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.344719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.345011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.345293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.346077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:02.346379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.373022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.401833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 210/420] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:02.406914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.416676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc025e5-021b-4e40-872e-7ce7c51bd9c8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.420667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.421244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.421530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.421809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.433683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.459784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.476680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:02.477699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:02.482812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.491887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438b7a-3835-48e0-a234-87994cce2892 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.495673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.496250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.496539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.496822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.497499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:02.497796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.523490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.535061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:02.540432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.549278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bd98b-2d21-4379-9d8f-a1fedb14e27a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.553071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.553760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.554043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.554315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.562937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.588435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.602262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:02.603285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:02.608303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.617316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217d04-1d1c-4219-b8f3-a01f8556193f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.621206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.621777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.622070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.622351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.623124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:02.623427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.649948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41804a-d840-4205-be37-2de54826e8c1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.663414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 212/424] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:02.668448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:02.677337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb10ef-60b3-4f68-b210-429930dfe6b0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:02.681187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:02.681966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:02.682253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:02.682531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.684276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=2e40067b250f40d997dad1817ccbbba6, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:02.710570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f278-c4a7-4d65-8528-2e81c385e9a6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.721855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 213/425] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:02 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:29:04.664064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f3d7-cc7a-4c2f-b587-7109267232d6 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.664609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f3d7-cc7a-4c2f-b587-7109267232d6 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.664609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f3d7-cc7a-4c2f-b587-7109267232d6 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.666292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 213/426] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:04.671272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.671660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.671836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.694901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:04.696018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:04.757171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 214/427] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:04.778586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3f3d7-cc7a-4c2f-b587-7109267232d6 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:04.790004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3f3d7-cc7a-4c2f-b587-7109267232d6 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:04.793791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:04.794502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.794827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.795112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.806889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:04.813128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:29:04.814184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 214/428] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:04.819653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:04.827969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31596b-d103-4e5a-879f-6f508f858fd4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:04.831860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:04.832436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.832720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.832994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.834194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:04.834484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:04.859835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:04.868228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 215/429] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:04.873305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:04.884645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e04fd9-9003-4616-b3b9-47c9ea23bce0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:04.888550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:04.889243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.889532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.889814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.901480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:04.927383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:04.944348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:04.945400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 215/430] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:04.950538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:04.960322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6755d80-736d-430d-84fb-aad13b3443e3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:04.964233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:04.964813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.965103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.965408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.966093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:04.966394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.001587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.016460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 216/431] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:05.022527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.031979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebc087-ff62-4008-b882-a765a2c6c017 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.035890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.036861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.037110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.037395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.049716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.075679 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.093705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:29:05.094794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 216/432] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:05.100197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.109308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc27872-6504-4b19-8741-f6342f511b3b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.113228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.113821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.114110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.114390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.115309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:05.115609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.141478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.170122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 217/433] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:05.175478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.184957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adefad-eea3-4f01-8b77-3ccb9d066f89 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.188755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.189319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.189606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.189885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.197766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.223427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.231651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 217/434] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:29:05.236683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.245753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583323a7-9f4a-41a5-9da5-37ec1067bf51 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.249644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.250347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.250636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.250953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.262876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.288844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.305701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:05.306751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 218/435] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:05.314482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.323048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f196b-9999-49f9-b2e4-77bebdb84fe6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.327042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.327642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.327934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.328220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.328916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:05.329220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.355389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.369508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 218/436] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:05.374922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.384329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee944c9-047e-4691-9c44-e91478047cff admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.388194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.388898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.389185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.389462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.399067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.425027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.438479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:05.439482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 219/437] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:05.445067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.454191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bfbd2-6bfc-43d0-b657-bec2085f297d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.458111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.459328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.459531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.459814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.460552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:05.460853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.486842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be162f34-9f26-4693-b546-905a06591dd8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.499443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 219/438] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:05.504905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:05.513945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f3eb-37bc-4a31-9d96-03d17c59d2a7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:05.517758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:05.518317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:05.518603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:05.518919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:05.519688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:05.519990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:05.546205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd4b19-7d1e-474f-8bfc-1527fb29fdce admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:05.551727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 220/439] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:05 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:07.546026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680c89-04d0-4863-970f-fd6ab61677ab None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:07.546546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680c89-04d0-4863-970f-fd6ab61677ab None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:07.546634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47680c89-04d0-4863-970f-fd6ab61677ab None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:07.548291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 220/440] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:07.553382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:07.553780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:07.553948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:07.576537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:07.577659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:07.584860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 221/441] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:07.605912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47680c89-04d0-4863-970f-fd6ab61677ab None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:07.617828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47680c89-04d0-4863-970f-fd6ab61677ab None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:07.621572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:07.622292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:07.622582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:07.622902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:07.623520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:07.649077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:07.649077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:29:07.649077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:29:07.649943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:07.661169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:29:07.662223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 221/442] 10.222.0.48 () {56 vars in 1153 bytes} [Fri Apr 8 02:29:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:07.667448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:07.675693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fa3ba-acaf-4508-98d2-8e523356ecf7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:07.680268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:07.680848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:07.681134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:07.681410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:07.682071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:07.682365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:07.706911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:07.706911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:29:07.706911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:29:07.707801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd804a-3c6f-4593-9650-2051ba86123a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:07.712628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 222/443] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:07.717538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:07.726771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c1468-5f0b-4d11-9b03-28bb1d6e4335 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:07.730603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:07.731216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:07.731513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:07.731797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:07.732460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:07.732761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:07.758083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:07.758083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:29:07.758083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:29:07.758973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc3104-e47d-468c-b4c1-67867893fc49 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:07.763301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 222/444] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:09.713096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb4b5-0a30-4164-be31-f4b8bd73fefc None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:09.713683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb4b5-0a30-4164-be31-f4b8bd73fefc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:09.713683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbb4b5-0a30-4164-be31-f4b8bd73fefc None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:09.715481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 223/445] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:09.720403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84d11-4626-4a40-97cf-979ae784432f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:09.720788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84d11-4626-4a40-97cf-979ae784432f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:09.720978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84d11-4626-4a40-97cf-979ae784432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:09.744061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-55d84d11-4626-4a40-97cf-979ae784432f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:09.745199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-55d84d11-4626-4a40-97cf-979ae784432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:09.751786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:09.774052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbb4b5-0a30-4164-be31-f4b8bd73fefc None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:09.785327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbb4b5-0a30-4164-be31-f4b8bd73fefc None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:09.789217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:09.789787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:09.790073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:09.790350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:09.791059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:09.815538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:09.815538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:29:09.815538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:29:09.816525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e95c68-8111-43ad-aea2-2ea8ad7a896a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:09.829946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 224/447] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:09 2022] POST /identity/v3/services => generated 269 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:11.818483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512876-13f0-490c-88c5-bb0a3353c300 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.819078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512876-13f0-490c-88c5-bb0a3353c300 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.819078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84512876-13f0-490c-88c5-bb0a3353c300 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.820741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 224/448] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:11.825983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.826386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.826599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.851765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:11.852907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:11.869711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 225/449] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:11 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:11.892472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84512876-13f0-490c-88c5-bb0a3353c300 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:11.904969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84512876-13f0-490c-88c5-bb0a3353c300 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:11.908993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:11.909947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.910271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.910734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.912751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:11.940764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:11.952554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:29:11.954221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 225/450] 10.222.0.48 () {56 vars in 1153 bytes} [Fri Apr 8 02:29:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:11.960240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:11.969286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8c0c7-ece6-42ec-a5e7-19c8d3cc66dc None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:11.973403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:11.974485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.974902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.975190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.975864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:11.976162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:12.001739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:12.007377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 226/451] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:12.013205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:12.023370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf34f6f-c860-4688-9c1e-f1ff9ad5c35a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:12.028887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:12.029477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:12.029767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:12.030051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:12.030754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:12.031058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:12.057931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:12.063254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 226/452] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:12.070741 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:12.079904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651df6-be44-4de5-8392-159c74f9424d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:12.084122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:12.084701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:12.084990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:12.085270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:12.086061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] RBAC: Adding query filter params (interface=public, service_id=5b54db6fa73249dfbb463f598823d64d, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:12.087609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:12.113688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:12.113688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:29:12.113688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:29:12.115507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03ed21-de19-415e-8259-2600966c271c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:12.121967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 227/453] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:12 2022] GET /identity/v3/endpoints?service_id=5b54db6fa73249dfbb463f598823d64d&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:12.128190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:12.140324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aabb-a8d4-4515-a151-d6573de5960a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:12.146987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:12.147948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:12.148710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:12.149066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:12.149734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:12.178444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04b70c-0c9c-4cb9-8d95-892a2a8dbe0c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:12.184578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 227/454] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:12 2022] GET /identity/v3/services => generated 562 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:14.144960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f6a6-7528-4645-8151-da1b3a8f7445 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.146090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f6a6-7528-4645-8151-da1b3a8f7445 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.146191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681f6a6-7528-4645-8151-da1b3a8f7445 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.147815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 228/455] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:14.153016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.153411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.153593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.176151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:14.177958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:14.184616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 228/456] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:14 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:14.206293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f6a6-7528-4645-8151-da1b3a8f7445 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:14.218464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681f6a6-7528-4645-8151-da1b3a8f7445 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:14.222240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:14.222999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.223285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.223720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.224733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:14.249092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:14.249092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:29:14.249092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:29:14.249901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:14.261825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:29:14.262885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 229/457] 10.222.0.48 () {56 vars in 1153 bytes} [Fri Apr 8 02:29:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:14.268437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:14.278212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a9ee9-122b-4000-8616-a14f4196cb0a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:14.282238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:14.282853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.283150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.283435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.284103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:14.284405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:14.310993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:14.315264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 229/458] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:14.321009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:14.330010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1237f6f-f934-4973-9e28-bd9672534d14 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:14.334556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:14.335165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.335456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.335740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.336408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:14.336707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:14.361732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e4e6-3131-43db-8674-0f17ce60ab63 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:14.367060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 230/459] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:29:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:14.371979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:14.381617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63160-b0ac-4a94-a730-4678511b7d16 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:14.385445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:14.386002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:14.386288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:14.386565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:14.387281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:14.412080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:14.412080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:29:14.412080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:29:14.412938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff9ce-f31a-41cf-9313-23e797bacff5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:14.431984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 230/460] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:16.389794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a9b5-0896-47d0-a9c9-2ed048b25264 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:16.390310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a9b5-0896-47d0-a9c9-2ed048b25264 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:16.390413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a9b5-0896-47d0-a9c9-2ed048b25264 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:16.392086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 231/461] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:16.398638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:16.399053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:16.399232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:16.421200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:16.422335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:16.441924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 231/462] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:16 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:16.465033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a9b5-0896-47d0-a9c9-2ed048b25264 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:16.477439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a9b5-0896-47d0-a9c9-2ed048b25264 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:16.481251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:16.481965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:16.482257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:16.482541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:16.483194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:16.512581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:16.523858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:29:16.524905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 232/463] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:16.530401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:16.539659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67414c09-1d59-49da-a7cd-6ed893211ede None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:16.543617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:16.544206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:16.544499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:16.544784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:16.545459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:16.545759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:16.571664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c2b9d-c901-4ee9-b3d2-5be5445c1428 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:16.576040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 232/464] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:16.581234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:16.591187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed2d1b-02e9-41de-8fe2-c5979b9fb106 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:16.595098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:16.595663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:16.595950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:16.596237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:16.596898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:16.597197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:16.623004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684545ac-a010-498c-91f4-a34bf0a0ab83 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:16.627182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 233/465] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:18.576692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92db6-329e-4a78-9537-ef19b928237c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:18.577259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92db6-329e-4a78-9537-ef19b928237c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:18.577259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92db6-329e-4a78-9537-ef19b928237c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:18.578935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 233/466] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:18.584741 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f0585-2bf6-4a02-b5fb-2938d91009a2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:18.585112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f0585-2bf6-4a02-b5fb-2938d91009a2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:18.585308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f0585-2bf6-4a02-b5fb-2938d91009a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:18.607153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-340f0585-2bf6-4a02-b5fb-2938d91009a2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:18.608273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-340f0585-2bf6-4a02-b5fb-2938d91009a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:18.614785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 234/467] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:18 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:18.636285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b92db6-329e-4a78-9537-ef19b928237c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:18.648349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b92db6-329e-4a78-9537-ef19b928237c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:18.652150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:18.652728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:18.653017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:18.653294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:18.653951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:18.678508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:18.678508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:29:18.678508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:29:18.679396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ecf57-8571-4bcb-9ac3-4ddc929fc026 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:18.692617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 234/468] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:18 2022] POST /identity/v3/services => generated 242 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:20.716079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abc0b-4890-4ca0-bad3-65572fe02b62 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.716608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abc0b-4890-4ca0-bad3-65572fe02b62 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.716698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696abc0b-4890-4ca0-bad3-65572fe02b62 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.718312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 235/469] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:20.723296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.724177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.724177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.746682 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:20.747838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:20.764744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 235/470] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:20 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:20.786549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696abc0b-4890-4ca0-bad3-65572fe02b62 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.797833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696abc0b-4890-4ca0-bad3-65572fe02b62 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.802194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.802925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.803209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.803480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.804099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:20.828874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.839016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:29:20.840047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 236/471] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:20.845618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.854795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade2e93-f9ce-492a-9a6e-5b2b7c5e67ff None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.858723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.859310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.859604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.859885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.860551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:20.860852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:20.886348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.890616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 236/472] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:20.895895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.905135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c974e4-5201-4e92-8667-01cbb7834399 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.909071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.909642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.909932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.910214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.911410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:20.911711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:20.937383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.942132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 237/473] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:20.947285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.956216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5da1c-645e-4360-ae09-2e5a3e9df107 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.960197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.960765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.961055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.961335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.962069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] RBAC: Adding query filter params (interface=public, service_id=4704ae43759c4434badd4f515f897fff, region_id=RegionOne) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:20.962374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:20.987214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:20.987214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:29:20.987214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:29:20.988077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5184-399f-43e2-b3fd-e4644c1bcea2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.994747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 237/474] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/endpoints?service_id=4704ae43759c4434badd4f515f897fff&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:21.000400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:21.010099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95002c-6c15-4217-8363-35c4bbce6083 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:21.014241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:21.014872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:21.015169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:21.015454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:21.016112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:21.042779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d7464-67fb-47a0-94b0-093a459bd5ff admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:21.047940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 238/475] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services => generated 792 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:23.045114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd6b-4414-4eb8-9928-887af66f33fd None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.045627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd6b-4414-4eb8-9928-887af66f33fd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.045717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055dd6b-4414-4eb8-9928-887af66f33fd None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.047455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 238/476] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:23.052540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.052935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.053112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.075553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:23.076679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:23.083869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 239/477] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:23 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:23.105150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055dd6b-4414-4eb8-9928-887af66f33fd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:23.116594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055dd6b-4414-4eb8-9928-887af66f33fd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:23.120421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:23.121123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.121414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.121697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.122310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:23.148265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:23.158363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:29:23.159426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 239/478] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:23.165397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:23.173759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a657cc0-4035-479b-ac99-81538d3b91cc None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:23.178274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:23.178887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.179181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.179460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.180131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:23.180459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:23.205752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:23.210602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 240/479] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:23.215692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:23.224523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8b83-3d18-4a39-bccf-e805c8afffab admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:23.228413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:23.228976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.229264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.229579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.230236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:23.230533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:23.256217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044be830-42d6-49f6-b892-81efe9af06e8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:23.260700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 240/480] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:23.265689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:23.275630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf43eb-7fb4-4517-8a8c-a356c34b5b46 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:23.279528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:23.280093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:23.280394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:23.280671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:23.281358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:23.305681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:29:23.305681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:29:23.305681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:29:23.306546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88067531-e38f-41f0-84ab-360e99b5bf33 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:23.324878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 241/481] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:25.344811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f5b2-3a11-4ee6-816e-a9bc8eea9f73 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.345331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f5b2-3a11-4ee6-816e-a9bc8eea9f73 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.345424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f5b2-3a11-4ee6-816e-a9bc8eea9f73 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.347060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 241/482] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:25.352633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.353023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.353206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.375683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:25.376819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:25.392487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 242/483] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:25 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:25.414598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f5b2-3a11-4ee6-816e-a9bc8eea9f73 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.425769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f5b2-3a11-4ee6-816e-a9bc8eea9f73 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.430212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.431012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.431302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.431580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.443386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:25.450098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:29:25.451175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 242/484] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:25.456427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.464691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c477-9c83-4b70-b60c-e72bb835cb85 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.468623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.469203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.469487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.469765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.470473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:25.470807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.496790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.505645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 243/485] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:25.510899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.520536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ada8-55d4-4bdc-9997-50fd9aad3351 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.524834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.525533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.525845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.526130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.537702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.562793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.579724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:25.580768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 243/486] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:25.586864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.595925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64597-0e5f-4e07-b6bf-197c2cfe01ca admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.599885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.600461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.600751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.601032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.601715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:25.602014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.627363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.640391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 244/487] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:25.645702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.655039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e5bf3-f856-4581-990e-1fd1deb6eb51 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.658992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.659690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.659984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.660270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.673426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.700312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.718004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:29:25.719075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 244/488] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:25.725260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.734330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5302f-6f3b-4e49-bb4f-97286009391c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.738227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.738871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.739259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.739544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.740324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:25.740623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.765916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.796663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 245/489] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:25.802472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.811570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b627c-56d1-4186-951f-e8171d18405b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.815503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.816067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.816357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.816637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.824671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.849805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.860317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 245/490] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:29:25.866227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.875261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897134-ce59-4a08-8882-64b5e8e26064 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.879134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.880648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.880930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.881213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.892437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.918063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.934830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:25.935861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 246/491] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:25.941020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:25.950133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce560793-681c-482f-8e9a-2f443785ee79 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:25.954049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:25.954629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:25.954956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:25.955233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:25.955915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:25.956215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:25.981442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:25.994540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 246/492] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:26.000030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:26.010479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e0037-bbb0-4ded-ac56-4ffed0618891 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:26.014413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:26.015152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.015446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.015731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.025263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:26.052548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:26.065809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:26.067274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 247/493] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:26.072708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:26.081843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebd8d-0fd9-4285-a0a1-8076cd316891 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:26.085877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:26.086453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.086775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.087059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.087797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:26.088101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:26.114423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81c7b-ef16-49e8-b688-6f6fa4143d5f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:26.126857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 247/494] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:26.132643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:26.141711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388a4a4-8de9-46ff-8e93-f5932b207abd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:26.145703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:26.146265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.146557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.146871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.147644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] RBAC: Adding query filter params (role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:26.148201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:26.173908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaae75-10ff-4aa7-9b07-3cb5178fd837 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:26.179953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 248/495] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:26 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.107531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4c01-e26b-43c0-926a-42723b484241 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.108066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4c01-e26b-43c0-926a-42723b484241 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.108158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad4c01-e26b-43c0-926a-42723b484241 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.109752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 248/496] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:28.115263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.115683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.115820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.137683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:28.138835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:28.145986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 249/497] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:28 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:28.168096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4c01-e26b-43c0-926a-42723b484241 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.179451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad4c01-e26b-43c0-926a-42723b484241 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.183309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.184027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.184312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.184586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.195358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:28.202097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:29:28.203167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 249/498] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:28.208979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.217289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fefe35-46ba-4c0e-a63e-a8812ee3747e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.221194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.221771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.222059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.222337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.223689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:28.223956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.248743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.257312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 250/499] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.262399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.272188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25873ff-c787-4dc0-a279-ce1c5f646141 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.276454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.277137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.277422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.277700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.289244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.314841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.332014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:28.333087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 250/500] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:28.338194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.347298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81822f-12ef-4e46-a516-fa4dc8a4371b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.352229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.352804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.353097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.353379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.354061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:28.354362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.380808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.393340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 251/501] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.399217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.408187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53fd79-52cf-4260-97d2-30337eb76183 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.412154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.412845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.413138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.413419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.425608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.451643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.469148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:29:28.470174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 251/502] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:28.475428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.484352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ddae-36f8-4dd1-addf-a4e180ddcdd9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.488228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.488821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.489105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.489386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.490160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:28.490456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.516530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.545300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 252/503] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.550477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.559572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08968e1-9413-4d01-8b0c-a613a8a6838c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.563434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.564133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.564420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.564699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.577063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.602774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.619448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:28.620488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 252/504] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:28.625652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.635331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158d9d7-8148-4034-a3be-36c0a18514d6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.639237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.639807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.640093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.640372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.641050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:28.641346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.669989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.682287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 253/505] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.687493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.697223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982c33-eb7b-475d-b514-d77ed1772b4d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.701070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.701768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.702052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.702328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.711115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.736196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.749875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:28.750928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 253/506] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:28.756783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.765776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124617-aeb4-4521-a2e2-f804fe6def71 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.769732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.770457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.770782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.771066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.771799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:28.772099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.797449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688998-9fe8-41dc-a71d-2f6ab0cdd91f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.810560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:28.815988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:28.825431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d69eb6-7208-447f-a3e3-72a3bcee4539 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:28.829310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:28.830099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:28.830384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:28.830688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/c1f10547cdde4f3d8a7ebd4b780f1cb5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:28.832721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=2e40067b250f40d997dad1817ccbbba6, role_id=c1f10547cdde4f3d8a7ebd4b780f1cb5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:28.858559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293a7fa-3604-44ea-b111-485c794f84ab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:28.871130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 254/508] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:28 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/2e40067b250f40d997dad1817ccbbba6/roles/c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:29:30.809604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c562e9-bc99-4392-8288-1e9f2e860c2b None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:30.810129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c562e9-bc99-4392-8288-1e9f2e860c2b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:30.810214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c562e9-bc99-4392-8288-1e9f2e860c2b None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:30.811872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 255/509] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:30.817287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:30.817700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:30.817862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:30.840579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:30.841711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:30.903737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 255/510] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:30 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:30.925394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c562e9-bc99-4392-8288-1e9f2e860c2b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:30.937250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c562e9-bc99-4392-8288-1e9f2e860c2b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:30.941039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:30.941831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:30.942131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:30.942401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:30.953291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:30.960767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:29:30.961824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:29:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:30.967281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:30.976452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1fb11-98fb-4208-ab32-2977b159be96 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:30.980424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:30.981011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:30.981323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:30.981588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:30.982297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:30.982596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.008537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.016952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 256/512] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:29:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.023283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.032883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0d3b-c4e7-4b23-88e0-4177e35b7e48 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.037455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.038153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.038437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.038750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.049626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.074869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.092411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:31.093444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 257/513] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.099409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.108476 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d3034-c171-43bb-a08e-c38d07ddcd80 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.112388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.112962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.113251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.113570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.114273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:31.114572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.139437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.152812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 257/514] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.157921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.167467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5ab6f-caeb-46a0-a8af-2a05d1e80b55 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.171363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.172054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.172338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.172614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.184880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.210810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.228547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:29:31.229571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 258/515] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.235059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.244312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39572b-6275-4369-8699-e93265965806 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.248278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.248863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.249155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.249437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.250216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:31.250519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.277549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.307097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 258/516] 10.222.0.48 () {56 vars in 1154 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.312549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.322810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695906bf-e5de-4f75-848e-8535c6fce60e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.326829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.327338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.327629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.327913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.336498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.362020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.370983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 259/517] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:31.376167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.385827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e6aa-aafc-4cf4-95b1-7a932e867c5e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.389776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.390475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.390789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.391086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.402798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.428920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.445279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:31.446315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 259/518] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.451525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.460467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ed6d5-017a-44c4-9aa6-abbe4bab501e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.464492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.465068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.465357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.465640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.466321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:31.466623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.493760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.508098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 260/519] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.513255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.522390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a652-5618-4ecc-b54f-a3b92aeb1913 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.526540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.527271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.527559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.527836 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.537003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.562345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.576240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:31.577316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 260/520] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.583102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.592058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be830c5-2a91-40fc-bdcd-e201437d7b4d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.595949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.596517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.596801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.597075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.597829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:31.598127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.623849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405747c9-556d-46b9-947d-8aa0819a943c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.636943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 261/521] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.642391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.651891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5604-612d-4d19-898b-6721d53302e1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.655934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.656501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.656790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.657069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.657837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] RBAC: Adding query filter params (role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=2e40067b250f40d997dad1817ccbbba6) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:31.658139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:31.683985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6d84-f178-4ccc-8130-95a56fc555d4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.689717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 261/522] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/role_assignments?user.id=2e40067b250f40d997dad1817ccbbba6&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:33.739135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c513c2f-0f88-408d-ae53-8810fa2f760c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:33.740153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c513c2f-0f88-408d-ae53-8810fa2f760c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:33.740269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c513c2f-0f88-408d-ae53-8810fa2f760c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:33.741953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 262/523] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:33.747095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:33.747489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:33.747660 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:33.771013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:33.772136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:33.778973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 262/524] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:33 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:33.802146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c513c2f-0f88-408d-ae53-8810fa2f760c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:33.813569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c513c2f-0f88-408d-ae53-8810fa2f760c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:33.817456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:33.818153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:33.818435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:33.818735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:33.829885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:33.855676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:33.872606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:33.873632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 263/525] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:33.879212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:33.887632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb1c2-398a-4e74-8afd-a85fb6c4d988 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:33.891598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:33.892174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:33.892458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:33.892733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:33.893408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:33.893702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:33.920466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1c3de-483e-4b60-b8a6-e695acf00532 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:33.932890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 263/526] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:33.938036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:33.947254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680eb92-cb36-4a5d-bbbd-f495565f78c8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:33.951153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:33.951730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:33.952015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:33.952292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:33.952937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:33.979066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134ddef-7448-420f-8ee5-163776036485 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:34.001725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 264/527] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:29:33 2022] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:35.995243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c59d-46ca-434f-a507-f6fb4867db4c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:35.995681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c59d-46ca-434f-a507-f6fb4867db4c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:35.995817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c59d-46ca-434f-a507-f6fb4867db4c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:35.997494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 264/528] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:36.002477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.002885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.003093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.026576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:36.027748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:36.034375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 265/529] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:36 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:36.056136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1c59d-46ca-434f-a507-f6fb4867db4c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.068369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1c59d-46ca-434f-a507-f6fb4867db4c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.072310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.073021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.073312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.073599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.085144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:36.091558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:36.092609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 265/530] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.097991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.106587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6586450-b675-4e4d-99d7-3849fc125dd0 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.110544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304e236-0311-4e09-875a-301367878384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.111159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304e236-0311-4e09-875a-301367878384 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.111448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304e236-0311-4e09-875a-301367878384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.111728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304e236-0311-4e09-875a-301367878384 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.112445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304e236-0311-4e09-875a-301367878384 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.112743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304e236-0311-4e09-875a-301367878384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.139229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304e236-0311-4e09-875a-301367878384 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.148387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 266/531] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.153483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.163074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e215b-cfd0-45ba-9e1c-41dbfe70e7e8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.167041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.167734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.168026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.168310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.179731 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.205421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.222542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:36.223623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 266/532] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.228731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304e236-0311-4e09-875a-301367878384 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.237722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304e236-0311-4e09-875a-301367878384 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.242319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.242926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.243222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.243503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.244184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.244483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.269854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.282358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 267/533] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:36.287431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.296332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0951ee2-8b56-4ee3-aff3-57fbad97e08f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.300312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.301567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.301855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.302134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.314406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.340464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.358295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:29:36.359365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 267/534] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.364797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.373773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ccf51-c575-4bf8-b598-226388f3bd96 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.377686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.378264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.378554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.378967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.379652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.379952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.405883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.434576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 268/535] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:36.439764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.448722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a7b4a-4e81-49c2-9890-ff90f75dbc62 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.452640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.453199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.453483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.453760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.461622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.487149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.495357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 268/536] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:36.500451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.509885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dd60d-f281-494b-916b-71bc241edb1e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.513836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.514542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.514867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.515149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.526780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.552861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.569227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:36.570252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 269/537] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.575313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.583574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fb143-8850-4a3f-ba34-a19e155066a0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.587546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.588115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.588402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.588683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.589357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.589654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.615596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.628051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 269/538] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.633037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.641905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024e7c-4391-4ab1-be7c-96865ea12ff2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.645989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.646691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.646992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.647271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.656180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.681766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.695558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:36.696580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 270/539] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.701904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.711670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25358-8e58-46c6-ae3b-e25693715360 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.715618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.716191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.716482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.716762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.717497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.717799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.743319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9a32c-6ac7-4cf1-b54e-a2270d0ae956 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.756608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 270/540] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.761819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.771414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207939b-8308-4ec2-b918-7f452f09be99 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.775631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.776195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.776485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.776764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.777530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=1c47875086994711af245d3b53b617f9) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:36.777834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:36.804395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011e4a0-2af3-48ac-8ac1-2e11ee3b9a7d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.809603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 271/541] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/role_assignments?user.id=1c47875086994711af245d3b53b617f9&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:38.745485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5114ad-915c-450a-9941-689ce0309ae1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.746017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5114ad-915c-450a-9941-689ce0309ae1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.746111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5114ad-915c-450a-9941-689ce0309ae1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.747739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 271/542] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:38.752826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.753218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.753390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.776756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:38.777885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:38.784439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 272/543] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:38 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:38.805778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5114ad-915c-450a-9941-689ce0309ae1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:38.817925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5114ad-915c-450a-9941-689ce0309ae1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:38.821762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:38.822465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.822789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.823074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.834144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:38.840520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:38.841565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 272/544] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:38.846948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:38.855851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fffe5b-76d9-46fe-bd3d-926e2c54a793 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:38.859740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:38.860322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.860604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.860887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.861591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:38.861885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:38.887624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:38.896055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 273/545] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:38.901545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:38.911516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ef082-1cb8-44cf-abb2-3903ecec473a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:38.915827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:38.916521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.916813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.917094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.933044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:38.959454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:38.977758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:38.978884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 273/546] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:38.984571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:38.994052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4553663-a4cd-4b64-9400-b579b9669a49 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:38.998071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:38.998608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:38.998932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:38.999212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:38.999896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:39.000195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.026617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.039513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 274/547] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.044927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.054493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ba22-1cec-4571-bc8a-3345a8e17113 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.058595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.059350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.059641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.059923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.074909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.100830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.118618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:29:39.119694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 274/548] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.125210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.135269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb0c60-9bca-4869-aa8f-9c3ba70b016b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.139295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.139885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.140181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.140465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.141253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:39.141557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.167333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.197694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 275/549] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.202903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.212004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2d89-bafb-46c8-adf0-73b17fa75f20 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.215975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.216681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.216970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.217249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.229190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.261132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.280107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:39.281218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 275/550] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.287304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.296610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3531289-4205-4159-b8f8-b9f8429e5892 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.301091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.301672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.302125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.302407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.303127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:39.303424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.329066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.340944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 276/551] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.346073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.355198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ca053-94c7-4d86-aeee-68791f218f4d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.359140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.359837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.360126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.360405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.369775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.395516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.408974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:39.410631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 276/552] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:39.415946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.424889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514449bb-8cf8-4037-9fb3-c264394d890a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.428953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.429519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.429806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.430086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.430854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:39.431155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.456450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f17adf-0e03-498d-9000-8af140089bdc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.469557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 277/553] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.475567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.484413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bd1e-da93-43bf-bca1-a9ed49d98c8f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.488362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.489231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.489518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.489796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/1c47875086994711af245d3b53b617f9/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.509367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=1c47875086994711af245d3b53b617f9, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:39.536386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d0c31-da44-4f09-a37c-c22980840b34 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.547732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 277/554] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:39 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/1c47875086994711af245d3b53b617f9/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:29:41.467244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157ba2-53f2-42d9-a800-3de6be3bf2ec None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.467790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157ba2-53f2-42d9-a800-3de6be3bf2ec None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.467790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157ba2-53f2-42d9-a800-3de6be3bf2ec None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.469456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 278/555] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:41.474520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.474923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.475121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.497485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:41.498620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:41.561317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 278/556] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:41 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:41.583903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157ba2-53f2-42d9-a800-3de6be3bf2ec None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.595323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a157ba2-53f2-42d9-a800-3de6be3bf2ec None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.599224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.599936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.600222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.600503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.611266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:41.618231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:41.619317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 279/557] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:41.624582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.633414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8703df-0444-4562-97aa-1cb759018555 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.637371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.637953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.638243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.638525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.639270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:41.639572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:41.664944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.673044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 279/558] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:41.678684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.688198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219642f-13ed-4c57-83e4-bf31f78a0ac4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.692900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.693591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.693876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.694153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.705024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:41.731305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.748481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:41.749502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 280/559] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:41.755419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.764392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55173da-d44c-4e04-b71d-8ef82c1109dd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.768375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.768949 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.770376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.770684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.771380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:41.771683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:41.796966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.809424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 280/560] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:41.814651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.824723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602244e8-815d-48ff-8b3d-dd3cc44734e5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.828716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.829418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.829709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.829994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.843547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:41.869853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.888219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:29:41.889273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 281/561] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:41.895478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.904724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03ffa-77dc-471b-bba9-9fea15d8c337 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.908662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.909238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.909525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.909831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.910605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:41.910936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:41.936375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.965437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 281/562] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:41.970901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.980105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64580eec-350b-46bf-a3b2-a103d3cdeb19 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.984145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.984652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.984942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.985223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.992797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.018488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.027656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 282/563] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:42.033152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.042316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1a7d3-adfd-4bc5-9b35-2b68d94d573d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.046303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.047058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.047350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.047634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.059066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.085349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.101974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:42.103076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 282/564] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.108416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.117445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e4e-ce7f-4ff9-9802-1989d73181d5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.121468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.122054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.122345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.122632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.123349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:42.123652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.149896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.162559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 283/565] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.167769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.177524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0077-c453-4d75-abb7-83205bea1fbe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.181426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.182122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.182413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.182718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.192161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.217228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.230532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:42.231613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 283/566] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.237103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.246888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1bc73-381d-4926-8bb1-876c35ca799f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.250883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.251460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.251752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.252034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.252776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:42.253080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.279427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395bcab-b4f7-4a63-9f6f-81a47c757928 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.292403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 284/567] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.297867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.307515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f99e02-8fe1-4436-85a0-613048b043fe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.311444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.312005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.312294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.312578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.313345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=1c47875086994711af245d3b53b617f9) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:42.313644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:42.339469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476da44-a699-4ba5-af79-e390f924db50 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.345044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 284/568] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/role_assignments?user.id=1c47875086994711af245d3b53b617f9&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:44.335948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10759a-c85a-4f2b-a9a3-1ea709f807c6 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.336483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10759a-c85a-4f2b-a9a3-1ea709f807c6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.336483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10759a-c85a-4f2b-a9a3-1ea709f807c6 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.338106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 285/569] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:44.343027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.343455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.343598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.368225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:44.369352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:44.375875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 285/570] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:44 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:44.399555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10759a-c85a-4f2b-a9a3-1ea709f807c6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.411488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10759a-c85a-4f2b-a9a3-1ea709f807c6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.415324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439629-a128-445f-be59-2527235f698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.416026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439629-a128-445f-be59-2527235f698d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.416317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439629-a128-445f-be59-2527235f698d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.416599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439629-a128-445f-be59-2527235f698d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.428084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35439629-a128-445f-be59-2527235f698d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:44.453362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35439629-a128-445f-be59-2527235f698d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.470462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-35439629-a128-445f-be59-2527235f698d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:44.471538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 286/571] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:44.477520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.485860 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d21b-39c8-4dc8-9af2-5fdfa450af50 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.489915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.490491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.490817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.491099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.491776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:44.492071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:44.516741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf22c98-79b5-4f65-bb7d-5e1003babb99 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.529775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 286/572] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:44.535698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439629-a128-445f-be59-2527235f698d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.544729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439629-a128-445f-be59-2527235f698d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.548654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.549233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.549522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.549801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.550442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:44.576688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bb2af-9662-42d0-b8f8-cbd7e5501cc4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.596260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 287/573] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:29:44 2022] POST /identity/v3/users => generated 254 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:46.570022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd427-62c8-4373-9f22-8599b0cd1395 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.570570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd427-62c8-4373-9f22-8599b0cd1395 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.570570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffd427-62c8-4373-9f22-8599b0cd1395 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.572282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 287/574] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:46.577202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.577644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.577743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.599644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:46.600761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:46.607258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 288/575] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:46 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:46.629982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffd427-62c8-4373-9f22-8599b0cd1395 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.641384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffd427-62c8-4373-9f22-8599b0cd1395 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.645282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.645981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.646273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.646564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.657762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:46.664328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:46.665381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 288/576] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:46.670574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.679550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7f777-8378-4962-8373-9963dc7b27e9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.683486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.684062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.684347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.684623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.685335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:46.685632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:46.711522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:46.719631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 289/577] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:46.724750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.734208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873567f-12d4-486a-8bc7-5b403083660f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.738804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.739495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.739786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.740069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.751149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:46.777554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:46.794470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:46.795530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 289/578] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:46.801444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.810331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b813-9295-4f11-b1b1-0ba5091c60f2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.814272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.814874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.815161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.815439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.816388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:46.816687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:46.841956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:46.854761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 290/579] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:46.859696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.868864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ca183-840e-4a6b-b8ea-1efd1b792789 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.872869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.873574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.873866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.874145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.886681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:46.913268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:46.931375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:29:46.932422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 290/580] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:46.937806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.947003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446979c-26c6-4011-9de7-72e18f752ad1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.950924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.951506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.951793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.952072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.952858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:46.953157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:46.979599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.009600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 291/581] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:29:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:47.015029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.025118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e536d-de93-4ac7-a00e-b7959d43b1d3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.029067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.029635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.029927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.030206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.037635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.063036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.071892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 291/582] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:29:47.076980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.086640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9442-8d7b-465a-9f64-0ea2939abb3c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.090562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.091286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.091573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.091858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.103166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.128262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.145859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:47.146921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 292/583] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:47.152349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.160717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a8a2-a0c1-4ee9-adf8-84e6d24e0924 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.164678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.165262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.165553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.165839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.166516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:47.166854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.192867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.205308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 292/584] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:47.210859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.219723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94a34-296e-475a-8937-cd8befe2d9c8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.223612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.224296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.224584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.224862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.233442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.259180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.273197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:47.274202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 293/585] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:47.279346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.288594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88cbdd-65da-48f1-9e2c-571799fbf23d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.292567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.293138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.293428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.293704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.294437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:47.294762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.320654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38acdd3a-0b8b-4b1a-87a8-02f328392158 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.333966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 293/586] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:47.339258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:47.348252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823edf2c-ce9b-4ed8-8f84-7891d2b3c4bf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:47.352123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:47.352678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:47.352963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:47.353283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:47.353999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=308263fadbd147cc83233494ca6510fd) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:47.354294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:47.380542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f97712-bc12-4983-93d5-261710941f9a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:47.385697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 294/587] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:47 2022] GET /identity/v3/role_assignments?user.id=308263fadbd147cc83233494ca6510fd&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.331643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4226c4-f6a6-4a8c-b25e-00d427e07360 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.332158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4226c4-f6a6-4a8c-b25e-00d427e07360 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.332158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4226c4-f6a6-4a8c-b25e-00d427e07360 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.333771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 294/588] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:49.338861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.339254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.339436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.362278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:49.364053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:49.370646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 295/589] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:49 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:49.392066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4226c4-f6a6-4a8c-b25e-00d427e07360 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.403931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4226c4-f6a6-4a8c-b25e-00d427e07360 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.407677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.408383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.408669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.408947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.420304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:49.427238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:49.428285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 295/590] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:49.433589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.442642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7db8-7ced-4f6c-a015-0406099678f5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.446600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.447210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.447503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.447787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.448510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:49.448827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.474805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.483129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 296/591] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.489018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.498565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a9f4b-bec8-4fa6-9332-a80ad4e8e96c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.502543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.503285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.503577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.503956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.514879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.541100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.558823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:49.559863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 296/592] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:49.565166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.574298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93f19-885f-46b6-995b-89b5c1859601 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.578274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.578875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.579173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.579460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.580146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:49.580448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.606167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.619969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 297/593] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.625205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.634576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8088b-279d-476d-b847-ad98d7596fa1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.638535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.639309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.639600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.639878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.652941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.678801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.696293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:29:49.697321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 297/594] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:49.702685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.712380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca7f6c-c275-4645-b58a-5355c5609ccd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.716319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.716902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.717193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.717468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.718244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:49.718542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.744566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.773326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 298/595] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.778438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.788578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d599cf-13ac-405a-b991-f753c9e8458e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.792531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.793236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.793527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.793807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.805955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.831097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.848631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:49.849690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 298/596] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:49.854770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.864013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191ad2f-1e4f-4539-8a04-656441ccb09b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.867906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.868479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.868793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.869070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.869752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:49.870047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.895556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.907619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 299/597] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.913582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.922712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b41cdc-ad3b-4d56-b870-37192f90549f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.926897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.927632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.927919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.928197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.936865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:49.962976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.977045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:49.978106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 299/598] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:49.983493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.992815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d67a7-1bab-4554-a6ed-e3134dcf3add admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.996807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.997392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.997684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.997965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.998743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:49.999046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:50.025854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cf2ca-722a-4c71-9fbe-32b9d648e1f8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:50.038579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 300/599] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:50.043966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:50.053113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4033f6-82e5-44d9-98cc-ec2fc0db5f95 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:50.056996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:50.057788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:50.058074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:50.058356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/308263fadbd147cc83233494ca6510fd/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:50.079384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=308263fadbd147cc83233494ca6510fd, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:50.105966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5e5e-9a78-4652-944d-d99a20adda09 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:50.117951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 300/600] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:50 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/308263fadbd147cc83233494ca6510fd/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:29:52.044159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae95b-06c8-4b09-9b36-81c5514e5f80 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.044660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae95b-06c8-4b09-9b36-81c5514e5f80 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.044748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae95b-06c8-4b09-9b36-81c5514e5f80 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.046390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 301/601] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:52.051367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.051730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.051933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.073902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:52.075072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:52.137440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 301/602] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:52 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:52.161401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae95b-06c8-4b09-9b36-81c5514e5f80 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.172788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae95b-06c8-4b09-9b36-81c5514e5f80 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.176869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.177583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.177872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.178149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.189115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:52.195539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:52.196599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 302/603] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:52.201968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.210911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080393d-7ce2-43d1-bc84-4d3d14e37ba4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.214824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.215403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.215690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.215968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.216674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.216972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.242439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.250509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 302/604] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:52.256346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.265839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081fdb-1fdf-4a02-90b1-15b9c1195fbc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.270599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.271328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.271617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.271898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.282998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.308361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.326112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:52.327193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 303/605] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:52.333568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.342871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36adcd-e215-4433-a814-a23dddaf1a79 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.346877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.347525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.347810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.348093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.348776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.349075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.374204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.387629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 303/606] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:52.392954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.402958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfacad-448a-4b39-9ebf-7f0931c91d89 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.406978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.407703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.407993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.408296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.420636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.446646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.464829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:29:52.465869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 304/607] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:52.471288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.480592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04cfd8-588b-44d7-bc7b-357c1ff82786 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.484670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.485257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.485549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.485833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.486621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.486965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.512993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.541653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 304/608] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:52.546996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.556094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5115-ae96-4d93-bd92-68b708125bac admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.560054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.560616 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.560904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.561185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.569237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.594453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.603367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 305/609] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:52.608599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.618318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978939f4-7be6-41e7-bc97-79bc38d01bf1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.622395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.623141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.623435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.623718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.635187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.667153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.685010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:52.686120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 305/610] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:52.691843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.700333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc61a9-39d3-4d7d-969f-f65b521e2006 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.704321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.704907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.705195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.705477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.706643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.706972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.732440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.746433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 306/611] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:52.751750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.761013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94832ac-eb72-4baa-bcf1-5641037c7c12 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.765003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.765656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.765946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.766223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.775707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.801571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.814645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:52.815792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 306/612] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:52.821250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.830285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd8059-c88e-473b-ba78-190ebda51692 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.835053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.835623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.835917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.836197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.836930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.837230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.862936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342d671-a957-4097-b85b-7eefeedf1728 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.875558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 307/613] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:52.881701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:52.890749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f0e54-56f8-4780-a1cd-f5d5923611d5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:52.894918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:52.895486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:52.895775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:52.896056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:52.896828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=308263fadbd147cc83233494ca6510fd) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:52.897133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:52.922581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326f976-7c7f-42ab-a52c-79122cf80827 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:52.928779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 307/614] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:52 2022] GET /identity/v3/role_assignments?user.id=308263fadbd147cc83233494ca6510fd&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:54.926075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9371c-4317-45db-9f65-04565ee4c433 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:54.926606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9371c-4317-45db-9f65-04565ee4c433 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:54.926606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9371c-4317-45db-9f65-04565ee4c433 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:54.928308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 308/615] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:54.933266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:54.933677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:54.933835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:54.956001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:54.957618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:54.964357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 308/616] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:54 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:54.986490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9371c-4317-45db-9f65-04565ee4c433 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:54.997937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9371c-4317-45db-9f65-04565ee4c433 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.001680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.002397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.002701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.003045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.013868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:55.021190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:29:55.022233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 309/617] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:29:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:55.028044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.037106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a83bdd-5795-4162-a2c6-c7962fae11ca None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.041031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.041615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.041901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.042178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.042914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.043212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.069338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.077495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 309/618] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:55.082676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.092083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc30-188e-44ae-8318-dcabad4d676d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.095971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.096652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.096970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.097308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.108085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.134167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.151410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:55.152426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 310/619] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:55.157549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.166576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c280249-3667-4df9-b002-40f65ba6dca4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.170603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.171212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.171507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.171791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.172477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.172781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.199242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.211719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 310/620] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:55.216712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.225541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd054-3ef9-48bc-88d0-e0123bb81f22 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.229467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.230169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.230455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.230764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.243631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.269376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.287689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:29:55.288690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 311/621] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:55.293980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.303775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433e867-c961-4151-abb1-6d4fb6aecf4c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.307749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.308335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.308626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.308906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.309695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.310000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.337432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.367129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 311/622] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:55.372558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.382226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc70a2-b1ae-4787-8d3b-9da2aa4a1e54 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.386184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.386796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.387089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.387372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.395587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.420817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.429048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 312/623] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:55.434150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.443701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9444-6688-4c89-936e-20116e6f129d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.447668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.448371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.448661 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.448942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.460372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.485990 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.502772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:55.503864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 312/624] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:55.509033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.517312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471b87-0105-480c-8a55-39a12b90b8cf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.521522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.522094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.522383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.522944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.523621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.523919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.549371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.563208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 313/625] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:55.568543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.577583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd00be-c0b4-4c93-a2eb-778be701b6be admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.581764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.582988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.583372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.583659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.592437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.619007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.632584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:55.633617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 313/626] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:55.638948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.649093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d6cc-c8dd-4258-94b7-27a5ab693cff admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.653071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.653645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.653936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.654218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.654983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.655282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.681049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883c5d5-4920-4f72-8dd9-90c87977fda2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.693712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 314/627] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:55.699163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:55.708787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456308c-0364-4f48-a052-66e5cbe90488 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:55.712759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:55.713277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.713569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.713851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.714619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] RBAC: Adding query filter params (role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=308263fadbd147cc83233494ca6510fd) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:55.714961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:55.740765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8325-64fa-4706-b33c-fae41d010c4f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:55.745948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 314/628] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:55 2022] GET /identity/v3/role_assignments?user.id=308263fadbd147cc83233494ca6510fd&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:57.669100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce6f8-e321-4b04-825a-3a9bed557668 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.669634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce6f8-e321-4b04-825a-3a9bed557668 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.669748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce6f8-e321-4b04-825a-3a9bed557668 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.671375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 315/629] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:57.677041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.677419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.677605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.699630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:57.700765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:57.707394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 315/630] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:57 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:57.728826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce6f8-e321-4b04-825a-3a9bed557668 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:57.741001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce6f8-e321-4b04-825a-3a9bed557668 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:57.744866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:57.745592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.745885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.746168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.757521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:29:57.764371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:29:57.765429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 316/631] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:29:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:57.771127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:57.779821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b8cad-fd51-40d4-992e-af78de583dfa None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:57.783814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:57.784947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.785266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.785546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.786248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:57.786545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:57.812843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:57.821352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 316/632] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:29:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:57.826657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:57.836220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626bab-8ff5-491e-990d-ccc9bc5c7961 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:57.840226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:57.840927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.841221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.841507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.853218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:57.879466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:57.897199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:57.898487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 317/633] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:57.903685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:57.913399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5d3d4-0f9c-4d79-807a-182e1568e8a6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:57.918056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:57.918633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.918944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.919273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.919905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:57.920201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:57.945461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:57.958600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 317/634] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:57.963982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:57.973851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71584243-7fa9-4dde-9b1d-521994627385 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:57.977794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:57.978520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:57.978841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:57.979124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:57.991913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.017636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.036925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:29:58.037965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 318/635] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:29:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:58.043460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.052531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d0a3-6537-4643-92ca-c511f9ed54f7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.056451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.057032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.057320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.057600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.058376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:58.058694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.084964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.118337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 318/636] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:58.123863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.133371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50f976-cd68-4d76-be2c-153c46433fc3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.137356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.138064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.138353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.138634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.151425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.177332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.193769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:58.194853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 319/637] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:58.200346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.210246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f8a4-b4d3-4b6a-8035-4ba73eba02d6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.214274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.214893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.215190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.215475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.216165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:58.216468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.242536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.254862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 319/638] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:58.260079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.269260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbd8dc-f8c6-4add-83a0-4297a76684f9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.273461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.274154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.274443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.274757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.283661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.309615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.323710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:58.324745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 320/639] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:58.329931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.339613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28d4a9-db75-4b23-a393-0e248ba6eb60 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.343663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.344241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.344535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.344822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.345568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:29:58.345878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.371532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a79e4-e377-46f4-8e88-02b2a919e8a9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.384888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 320/640] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:58.390190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.399431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae704c3-c275-4103-8133-ab7817955a49 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.403326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.404113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.404395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.404671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/308263fadbd147cc83233494ca6510fd/roles/c1f10547cdde4f3d8a7ebd4b780f1cb5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.406628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=308263fadbd147cc83233494ca6510fd, role_id=c1f10547cdde4f3d8a7ebd4b780f1cb5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:29:58.433826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d5da-b5c5-4d7b-b2c3-9955b9cbf75e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.445257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 321/641] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:58 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/308263fadbd147cc83233494ca6510fd/roles/c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:30:00.371598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36eb7-4e72-411e-8721-53682186414e None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.372107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36eb7-4e72-411e-8721-53682186414e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.372212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36eb7-4e72-411e-8721-53682186414e None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.373841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 321/642] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:00.379007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.379393 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.379568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.403616 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:00.404744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:00.466010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 322/643] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:00 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:00.487927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d36eb7-4e72-411e-8721-53682186414e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.499375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d36eb7-4e72-411e-8721-53682186414e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.503908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.504633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.504928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.505213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.516233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:30:00.523549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:30:00.524611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 322/644] 10.222.0.48 () {56 vars in 1141 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:00.529786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.538579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f061df-7574-4370-a93e-b5e6d0a306e2 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.542467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.543076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.543364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.543644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.544353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:00.544649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.570171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.578219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:00.583551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.593049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd0545-4373-45af-899a-34c67e7cd8a0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.597557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.598254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.598549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.598875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.609749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.636384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.654680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:00.655737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:00.661044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.670077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce46c49-591a-4956-af45-4c1587edfde0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.674042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.674618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.675145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.675451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.676139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:00.676440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.702087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.715133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:00.720158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.729089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fdcd1-5631-43a7-8b80-8f7b87c0d3b5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.733013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.733729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.734016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.734296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.746563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.773382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.790971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:30:00.791995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 324/648] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:00.797250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.806224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968cec-a838-4bae-93c5-64df8351c3bb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.810188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.810784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.811074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.811355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.812136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:00.812439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.838475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.867635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 325/649] 10.222.0.48 () {56 vars in 1170 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:00.872946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.882543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907149f-652a-46cc-b152-435e0cb54bb5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.887397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.887932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.888220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.888514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.896511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.923979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:00.933205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 325/650] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:00.938809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:00.948285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64ce20-37f5-4379-87d9-e7c02ff9db31 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:00.952248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:00.952960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.953250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.953532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.965669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:00.991502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.008372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:01.009447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 326/651] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.014926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.024205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e0aa-98ab-4760-b710-91022fcfd90c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.028197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.028773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.029060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.029342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.030023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:01.030320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:01.056027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.068871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 326/652] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:01.074152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.083675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd4997-9160-4c91-b69f-8d4fac3d29e4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.087552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.088244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.088528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.088800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.098121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:01.123240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.136441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:01.137510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 327/653] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.142805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.152656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cede8-ca08-4017-8601-d2fe79a1adfa admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.156638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.157217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.157509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.157790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.158530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:01.158870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:01.184854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75079d-3be2-470d-9e99-032ae35d6705 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.198929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 327/654] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:01.204342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.213990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c1872-16f1-40c2-a661-fd3b59a09be4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.217889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.218458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.218778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.219055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.219826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] RBAC: Adding query filter params (role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=308263fadbd147cc83233494ca6510fd) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:01.220126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:01.246096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068845b2-798d-4745-b5ff-e329a010a4d8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.251768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 328/655] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/role_assignments?user.id=308263fadbd147cc83233494ca6510fd&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=c1f10547cdde4f3d8a7ebd4b780f1cb5 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:03.211537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c0db-b644-4307-9a44-90bf84d7019c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.212054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c0db-b644-4307-9a44-90bf84d7019c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.212144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c0db-b644-4307-9a44-90bf84d7019c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.213763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 328/656] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:03.218633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.219022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.219222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.241687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:03.242768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:03.249268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 329/657] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:03 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:03.271210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c0db-b644-4307-9a44-90bf84d7019c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.282871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c0db-b644-4307-9a44-90bf84d7019c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.287521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.288208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.288494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.288773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.289389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:03.314298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.324273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:30:03.325309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 329/658] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:03.331391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.339994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358107ea-0854-4b9b-8aeb-5c966251d0d2 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.343905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.344491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.344778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.345055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.345720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] RBAC: Adding query filter params (name=image) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:03.346016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:03.371758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3195c8-dd94-4ab1-b599-af9bf4d9cd7a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.375992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 330/659] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:03.381298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.390176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100a-121f-4ecd-ac8d-68b9f80ae024 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.394714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.395286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.395572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.395849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.396506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:03.396800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:03.422497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557ce48-6255-475f-b11a-8d4417f10a84 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.426744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:05.368181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbbaeb-d256-434c-a084-edb5e7ec9596 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:05.368710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbbaeb-d256-434c-a084-edb5e7ec9596 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:05.368803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbbaeb-d256-434c-a084-edb5e7ec9596 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:05.370401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 331/661] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:05.375586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be85fa-d388-439b-aeda-b60bc190aaf9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:05.376017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be85fa-d388-439b-aeda-b60bc190aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:05.376175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be85fa-d388-439b-aeda-b60bc190aaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:05.398871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-71be85fa-d388-439b-aeda-b60bc190aaf9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:05.399995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-71be85fa-d388-439b-aeda-b60bc190aaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:05.406467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 331/662] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:05 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:05.427702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbbaeb-d256-434c-a084-edb5e7ec9596 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:05.438979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbbaeb-d256-434c-a084-edb5e7ec9596 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:05.442830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:05.443403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:05.443689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:05.443966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:05.444633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:05.469955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8199ba-62fe-42bd-a7d5-a6b3a324d313 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:05.482514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 332/663] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:05 2022] POST /identity/v3/services => generated 242 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:07.429000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6f35-5301-4ce1-828e-28c4007a71fc None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.429543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6f35-5301-4ce1-828e-28c4007a71fc None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.429543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6f35-5301-4ce1-828e-28c4007a71fc None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.431262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 332/664] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:07.436170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.436588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.436733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.458740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:07.459853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:07.476668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 333/665] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:07 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:07.498262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6f35-5301-4ce1-828e-28c4007a71fc None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:07.509591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6f35-5301-4ce1-828e-28c4007a71fc None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:07.513392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:07.514098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.514387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.514686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.515317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:07.541104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:07.551614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:30:07.552653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 333/666] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Apr 8 02:30:07 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:07.558085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:07.566772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8485f-e53f-47d6-9da5-3b5fee4d605d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:07.570854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:07.571441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.571735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.572022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.572700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:07.573003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:07.598833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:07.603363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 334/667] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:07.608839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:07.618656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5afff-42ac-49d0-b927-512913410567 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:07.622538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:07.623145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.623433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.623711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.624375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] RBAC: Adding query filter params (type=image) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:07.624675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:07.651031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:07.655622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 334/668] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:07.661610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:07.670730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072433-ad39-4fd8-8b8d-29aa88511cb5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:07.674650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:07.675313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.675602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.675889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.676633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] RBAC: Adding query filter params (interface=public, service_id=e611f65e03f8475ca11e330861290eea, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:07.676938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:07.701811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c51ed-e48a-4e74-895a-1bea1ab66b0a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:07.707302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 335/669] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:30:07 2022] GET /identity/v3/endpoints?service_id=e611f65e03f8475ca11e330861290eea&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:07.712176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:07.721033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55597013-e27d-4ad6-bc79-4eb6b805389e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:07.725593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:07.726162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:07.726453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:07.726768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:07.727408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:07.752473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e4070-5f8d-4dbc-be90-cc82ebb75d03 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:07.757822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 335/670] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:07 2022] GET /identity/v3/services => generated 1022 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:30:09.736316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3f8c-6833-453a-aa3e-0104a0ac3ba3 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.736887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3f8c-6833-453a-aa3e-0104a0ac3ba3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.736887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3f8c-6833-453a-aa3e-0104a0ac3ba3 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.738549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 336/671] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:30:09.743805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.744185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.744371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.766905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:09.768685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:09.775608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 336/672] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:09 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:09.796875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3f8c-6833-453a-aa3e-0104a0ac3ba3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.808361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3f8c-6833-453a-aa3e-0104a0ac3ba3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.812202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.812899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.813182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.813457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] PATH_INFO: `/v3/services/image` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.814073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:09.840399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.850543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:30:09.851591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 337/673] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:09.857055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.866042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5f4c7-78de-448c-a13b-1dc30660710a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.870032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.870611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.870933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.871215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.871886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] RBAC: Adding query filter params (name=image) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:09.872187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:09.902164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.907753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 337/674] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.914261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.923430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba1e4-65a7-4ec7-89fe-c43beb7892ae admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.927577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.928157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.928444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.928723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.929388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:09.929682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:09.957405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c4ef-67ea-4edb-9eba-e05a48033003 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.962248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 338/675] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.967640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.977502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4b359-e34d-4819-8536-fea22559e1ca admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.981553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.982130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.982423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.982739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.983443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:10.008603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcccfbb-7f11-459b-847a-be803ec26074 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:10.025976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 338/676] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:11.986249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972509-bec5-4b05-ac5c-77d8e58920c9 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.986634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972509-bec5-4b05-ac5c-77d8e58920c9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.986984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972509-bec5-4b05-ac5c-77d8e58920c9 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.988757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 339/677] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:11.993723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.994136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.994293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.016856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:12.018649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:12.034638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 339/678] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:11 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:12.055522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a972509-bec5-4b05-ac5c-77d8e58920c9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.067279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a972509-bec5-4b05-ac5c-77d8e58920c9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.071131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.071694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.071978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.072255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.079621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:12.105253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c48de-eb69-4b60-8f78-f3273d0cc483 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.114730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 340/679] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:12.119935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.128361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18a86-98cc-4f67-8bdd-992a0b90807f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.132342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.133049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.133339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.133621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.134711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:12.161250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eced1-3153-4ca4-a871-c8dfac5ea903 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.162676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 340/680] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:14.295222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894550-e4db-4fcf-871b-d8d71a099f76 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.295762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894550-e4db-4fcf-871b-d8d71a099f76 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.295762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894550-e4db-4fcf-871b-d8d71a099f76 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.297363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 341/681] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:14.303011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.303449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.303580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.325459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:14.326589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:14.333398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 341/682] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:14 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:14.356476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894550-e4db-4fcf-871b-d8d71a099f76 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.368470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894550-e4db-4fcf-871b-d8d71a099f76 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.372246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.372944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.373232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.373508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.384778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:14.411455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.428046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:14.429084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 342/683] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:14.434761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.443169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ca13-ad70-4d06-abc3-80e1e4f711d7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.447160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.447742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.448033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.448316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.448998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:14.449298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:14.475337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8e40-c0d8-4b7a-ab36-646ba9433de1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.487965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 342/684] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:14.493392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.502470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4cd68-8f2b-4ae2-897b-22919289b154 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.506528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.507139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.507426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.507703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.508341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:14.534809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ca1c2-7066-4ff0-bc5b-9ca9b66b60ef admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.555681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 343/685] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:30:14 2022] POST /identity/v3/users => generated 248 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:16.592908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142fbf-76ee-4339-b6e4-bfcdd84807e3 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.593454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142fbf-76ee-4339-b6e4-bfcdd84807e3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.593454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142fbf-76ee-4339-b6e4-bfcdd84807e3 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.595186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 343/686] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:16.600235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.600676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.600775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.622636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:16.623783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:16.630917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 344/687] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:16 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:16.653078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142fbf-76ee-4339-b6e4-bfcdd84807e3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.664856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142fbf-76ee-4339-b6e4-bfcdd84807e3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.668703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.669413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.669704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.669989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.681484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:30:16.687913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:16.688968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 344/688] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:16.694431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.702717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5d09-1ec0-43b3-a1b9-0fe6b5c97bc9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.707431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.708038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.708324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.708601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.709305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:16.709598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:16.734971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:16.743198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 345/689] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:16.748369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.757890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f50d1-21cd-4d9d-ab59-6485aa72d5f1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.761792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.762484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.762815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.763098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.774721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:16.801019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:16.817940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:16.819030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 345/690] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:16.824400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.833982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e49d9-1a50-4409-9a11-9fbf5287103c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.837955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.838530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.838859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.839144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.839824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:16.840122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:16.865853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:16.878071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 346/691] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:16.883220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.892195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d380e-7f55-404f-a378-ba9f078140a8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.897644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.898341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.898633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.898953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.912380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:16.938928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:16.957717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:30:16.958814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 346/692] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:16.964324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.974175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317e31c-8353-425e-a72f-c6bdf7f8ebf1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.978261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.978952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.979309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.979654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.980507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:16.980895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.006952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.036201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 347/693] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:30:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:17.041715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.051019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a2f4-91f5-41a3-9125-249bfc599505 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.054949 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.055510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.055797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.056072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.063394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.089726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.098091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 347/694] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:17.103331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.113089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88aa5-8b43-48f3-ba78-f03a3d8de4ac admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.117165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.117825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.118120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.118405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.130683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.157224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.174589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:17.175659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 348/695] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:17.180814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.189018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b81d-ad98-43d4-a3a0-8fdea01f7a6e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.193512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.194082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.194371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.194652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.195344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:17.195640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.220598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.233692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:17.239424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.248381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3838bd-2a08-492f-8f67-122820969d22 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.253343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.254038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.254331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.254616 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.263290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.290143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.304133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:17.305161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:17.310425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.319888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836cbe7-2de4-4012-b6f2-4ab4837b77e5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.323828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.324395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.324681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.324961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.325694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:17.325993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.351959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de047ebb-edbd-4ec7-afe0-ba6d7435cbcb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.365156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 349/698] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:17.370780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:17.380338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4907ec-5c8b-4291-9ee1-9a6c1ff013fc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:17.384285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:17.384850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:17.385141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:17.385423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:17.386192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=1331f8c76c344c1eba589f81eb365d18) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:17.386497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:17.412370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64069ea-8ac2-40bf-b02d-064d9f00cf22 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:17.417568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 350/699] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:17 2022] GET /identity/v3/role_assignments?user.id=1331f8c76c344c1eba589f81eb365d18&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:19.341863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b6f-5a05-4c5e-abaf-134a110df78a None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.342392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b6f-5a05-4c5e-abaf-134a110df78a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.342495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b6f-5a05-4c5e-abaf-134a110df78a None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.344122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 350/700] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:19.350077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.350521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.350656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.373950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:19.375116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:19.381919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 351/701] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:19 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:19.403103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b6f-5a05-4c5e-abaf-134a110df78a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.415411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b6f-5a05-4c5e-abaf-134a110df78a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.419258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.419969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.420261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.420546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.432077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:30:19.438343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:19.439615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 351/702] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:19.444863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.453184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be265ae-4769-4d76-ae76-e135c4af9e8b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.457220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.457800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.458088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.458367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.459107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:19.459402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.484945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.493867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:19.499276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.508940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df75c-53bc-4a63-9720-5b930ef6af14 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.512983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.513681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.513975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.514256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.525420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.551903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.569864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:19.570936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 352/704] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:19.576343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.585329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaedbd-8574-499c-9d64-566e31ef2118 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.589263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.589836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.590122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.590401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.591117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:19.591412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.617382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.629582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 353/705] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:19.634655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.644264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b817a5-e9ab-40e0-9efb-4bda20b4a64b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.648587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.649283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.649571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.649849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.662782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.688095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.705619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:30:19.706869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 353/706] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:19.712101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.721715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd78fe-7d4d-4de1-bc30-f9a71b42ee27 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.725898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.726480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.726806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.727086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.727870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:19.728170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.754129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.784187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 354/707] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:19.789455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.798568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9d6c5-4f41-4a3e-b759-4015607b24b0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.802746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.803448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.803739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.804021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.816120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.841666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.858775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:19.859848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 354/708] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:19.865357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.874368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f2dc0-b3b3-466f-9c8b-67b10dfb08aa admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.878403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.879008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.879294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.879571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.880248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:19.880543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.906203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.918442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 355/709] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:19.923638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:19.933155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b640e7-d138-441a-9a98-22b8f6efe57e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:19.937080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:19.937787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:19.938054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:19.938326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:19.947286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:19.973358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:19.986800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:19.987907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 355/710] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:19.993402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:20.003434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93f89-c2f9-4862-8b8f-c2a3200f34d7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:20.007507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:20.008088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:20.008382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:20.008666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:20.009481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:20.009779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:20.036207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70555a32-5cdc-4b3a-a5e0-e174b2db6324 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:20.049116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 356/711] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:20.054740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:20.063737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29a70-5fdf-4876-8cd4-b5abe813d0e4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:20.068141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:20.068935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:20.069221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:20.069499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/1331f8c76c344c1eba589f81eb365d18/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:20.089274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=1331f8c76c344c1eba589f81eb365d18, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:20.115170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf83b6-4446-4a9d-a056-426ea9bd10fd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:20.127523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 356/712] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:20 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/1331f8c76c344c1eba589f81eb365d18/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:30:22.067486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fa80-c528-4362-9439-6ea10e829caa None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.068004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fa80-c528-4362-9439-6ea10e829caa None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.068094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5fa80-c528-4362-9439-6ea10e829caa None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.069787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 357/713] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:22.074947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.075331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.075516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.098319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:22.099477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:22.160297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 357/714] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:22 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:22.182249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fa80-c528-4362-9439-6ea10e829caa None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.193931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5fa80-c528-4362-9439-6ea10e829caa None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.197912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.198618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.198931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.199207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.210558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:30:22.216850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:22.217923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 358/715] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:22.224311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.232867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08d7b-d541-4262-83c2-e495a4bf30cd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.237488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.238027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.238322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.238609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.239405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.239717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.274884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.283477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 358/716] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:22.289115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.300754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24922a8-c015-440a-ab77-d662e135e3c1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.304731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.305436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.305724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.306002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.317359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.342892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.360008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:22.361052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 359/717] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:22.366551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.375562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a5b7-870a-41e6-8806-308b2b58a972 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.380047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.380632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.380921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.381221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.381973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.382269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.407913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.420557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 359/718] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:22.426152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.435318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548afda-c850-4ab8-88a1-dfd8cf5c0940 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.439854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.440791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.441079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.441356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.453720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.479640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.497123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:30:22.498128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 360/719] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:22.504399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.513650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046962f-1985-4955-bf84-423a5003b37c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.518224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.518841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.519131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.519404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.520181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.520480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.546173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.575239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 360/720] 10.222.0.48 () {56 vars in 1158 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:22.581802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.590979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569f4d-eca7-4040-b421-c77d3b943348 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.595001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.595567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.596299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.596586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.604120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.631364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.639625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:22.645090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.654259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f62e3-83aa-4db9-9bc0-782eb95c24f4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.658229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.658958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.659244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.659519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.670644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.697199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.713471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:22.714527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 361/722] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:22.719688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.728026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085244dd-41dc-4483-8999-d6e3007cf9aa admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.732059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.732630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.732918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.733200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.733877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.734178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.760152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.773143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 362/723] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:22.778162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.787762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae65a9-f5d1-4d2a-9e43-9a3a52a96ec0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.791676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.792363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.792651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.792926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.803581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.829100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.842152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:22.843201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 362/724] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:22.848596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.857618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b41-61f8-4a59-8ee5-8127676ae21b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.862133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.862726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.863019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.863303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.864043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.864345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.890092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc25-c1b3-4fee-b123-7cbe0f38b756 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.903040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 363/725] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:22.908370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:22.917550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050f22-f779-4d0a-9ddb-2e39dba82f86 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:22.922492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:22.923203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:22.923494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:22.924381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:22.925151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=1331f8c76c344c1eba589f81eb365d18) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:22.925454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:22.950759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a70e4-c354-4132-96eb-4cf5306575bd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:22.957330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 363/726] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:22 2022] GET /identity/v3/role_assignments?user.id=1331f8c76c344c1eba589f81eb365d18&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:24.977337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140dd-9b74-4345-af82-c0cac90760da None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:24.977876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140dd-9b74-4345-af82-c0cac90760da None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:24.978178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140dd-9b74-4345-af82-c0cac90760da None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:24.980807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 364/727] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:24.986089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:24.986478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:24.986733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.009965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:25.011182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:25.018874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 364/728] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:24 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:25.041116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321140dd-9b74-4345-af82-c0cac90760da None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.052918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321140dd-9b74-4345-af82-c0cac90760da None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.056705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.057427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.057713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.057992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.058608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:25.084058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.094553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:30:25.096648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 365/729] 10.222.0.48 () {56 vars in 1150 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:25.102290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.110798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1df7-7ef0-44ee-9df5-60ce61c7cf25 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.115042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.115625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.115915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.116191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.116857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:25.117152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:25.141915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfbb0-6821-4ae5-9949-edeb78e873de admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.146815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 365/730] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:25.152158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.161644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff7840-7168-4626-b991-e14ddb1bb4e5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.165585 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.166152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.166436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.166751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.167410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:25.167705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:25.192755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb2ec2-eebf-44dd-b993-9a5f76d3c8bc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.196850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 366/731] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:27.145103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d574c6a-3e4d-4a6d-be61-26b432ea9d24 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:27.145619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d574c6a-3e4d-4a6d-be61-26b432ea9d24 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:27.145705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d574c6a-3e4d-4a6d-be61-26b432ea9d24 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:27.147622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 366/732] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:27.152539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76999-a734-4c8c-bf20-54feea63d993 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:27.152971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76999-a734-4c8c-bf20-54feea63d993 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:27.153108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76999-a734-4c8c-bf20-54feea63d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:27.175630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a8a76999-a734-4c8c-bf20-54feea63d993 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:27.176761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a8a76999-a734-4c8c-bf20-54feea63d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:27.183442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 367/733] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:27 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:27.205259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d574c6a-3e4d-4a6d-be61-26b432ea9d24 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:27.216570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d574c6a-3e4d-4a6d-be61-26b432ea9d24 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:27.221117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:27.221696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:27.221985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:27.222268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:27.222968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:27.247658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89597db7-07e1-4c24-a107-3804dd705c8e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:27.259773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 367/734] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:27 2022] POST /identity/v3/services => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:29.225959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bccc7-6de1-4a5c-97e2-2e798357afe2 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.226496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bccc7-6de1-4a5c-97e2-2e798357afe2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.226591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bccc7-6de1-4a5c-97e2-2e798357afe2 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.228213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 368/735] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:29.233221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.233588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.233804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.257280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:29.258362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:29.275497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 368/736] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:29 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:29.296270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bccc7-6de1-4a5c-97e2-2e798357afe2 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:29.307952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bccc7-6de1-4a5c-97e2-2e798357afe2 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:29.311788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:29.312500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.312788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.313062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.313678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:29.339285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:29.350255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:30:29.351304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 369/737] 10.222.0.48 () {56 vars in 1150 bytes} [Fri Apr 8 02:30:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:29.356734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:29.365895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf7215-34bf-4739-be6e-36469fa17ffa None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:29.369901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:29.370502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.370828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.371115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.371812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:29.372111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:29.398326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:29.402753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 369/738] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:29.408490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:29.417346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9100c-cafe-45e3-9c8e-63c40a1082c1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:29.421426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:29.421992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.422275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.422549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.423231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:29.423731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:29.448508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:29.453013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 370/739] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:29.458862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:29.467713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e97-71d5-4529-bfe8-1020f25273e7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:29.472337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:29.472900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.473191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.473475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.474212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] RBAC: Adding query filter params (interface=public, service_id=07a8e04d18634214874706f08b4351af, region_id=RegionOne) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:29.474517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:29.499169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ac3e5-8d13-4195-a4e2-dc4f0adfe609 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:29.504214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 370/740] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:30:29 2022] GET /identity/v3/endpoints?service_id=07a8e04d18634214874706f08b4351af&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:29.509191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:29.519087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10308920-6bc4-4f69-baa3-1854594b392b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:29.523509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:29.524092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:29.524385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:29.524669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:29.525316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:29.551747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13dbe9-e4dd-40ec-ad8b-32846c1d4ca0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:29.557256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 371/741] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:29 2022] GET /identity/v3/services => generated 1261 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:30:31.510383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c05f9-e26c-4c58-941c-6d170f3786ec None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.510934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c05f9-e26c-4c58-941c-6d170f3786ec None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.511019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c05f9-e26c-4c58-941c-6d170f3786ec None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.512622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 371/742] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:31.518219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.518648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.518815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.540855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:31.542080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:31.548647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 372/743] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:31 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:31.570096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c05f9-e26c-4c58-941c-6d170f3786ec None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:31.581615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c05f9-e26c-4c58-941c-6d170f3786ec None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:31.585470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:31.586180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.586468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.586770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.587383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:31.613819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:31.624583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:30:31.625687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 372/744] 10.222.0.48 () {56 vars in 1150 bytes} [Fri Apr 8 02:30:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:31.631523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:31.639976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ae8b-f6fc-46f6-853c-02335176bc5c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:31.644658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:31.645238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.645524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.645802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.646470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:31.646800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:31.672667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:31.677110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 373/745] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:31.682160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:31.691191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bab4e-cb79-4932-8aac-958d925d7c41 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:31.695435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:31.696019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.696311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.696594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.697263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:31.697563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:31.723625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9ce92-a16f-407a-92cd-28a123712aec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:31.728290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 373/746] 10.222.0.48 () {56 vars in 1145 bytes} [Fri Apr 8 02:30:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:31.733518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:31.742680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2342c61-8e4a-44ed-bcd6-7993a07a6d63 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:31.746802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:31.747367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:31.747656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:31.747943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:31.748630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:31.774610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412268-28fc-4d61-a90a-c5cdbbb71fd2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:31.792727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 374/747] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:33.793119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae155d-3ca7-4911-9f43-d4e326bdacef None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:33.793674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae155d-3ca7-4911-9f43-d4e326bdacef None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:33.793674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae155d-3ca7-4911-9f43-d4e326bdacef None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:33.795402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 374/748] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:33.801221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:33.801612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:33.801789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:33.824160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:33.825277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:33.842355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 375/749] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:33 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:33.864127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae155d-3ca7-4911-9f43-d4e326bdacef None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:33.875673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae155d-3ca7-4911-9f43-d4e326bdacef None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:33.880262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:33.880975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:33.881300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:33.881584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:33.882205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:33.907471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:33.917768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:30:33.918875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 375/750] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:33 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:33.924988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:33.933401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873d6b-b7b5-4ce9-af23-08b2eb62176f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:33.937415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:33.937999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:33.938288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:33.938566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:33.940183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:33.940686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:33.982766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8236-791b-4d5e-b382-b7aa9bc02056 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:33.989485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 376/751] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:33 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:33.995175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:34.006447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffe1e-a696-4d5f-af2e-f86e5f3a47ce admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:34.010761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:34.011346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:34.011640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:34.011923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:34.012596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:34.012899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:34.038292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b601c5-9a72-4c06-b889-2d08305710bc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:34.042574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 376/752] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:33 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:35.980415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b296-e2a8-4a9e-93dc-7c3afa8f450c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.980934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b296-e2a8-4a9e-93dc-7c3afa8f450c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.981046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33b296-e2a8-4a9e-93dc-7c3afa8f450c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.982653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 377/753] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:35.988453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc360cb-0121-435a-94b5-f205476c5766 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.988869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc360cb-0121-435a-94b5-f205476c5766 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.989016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc360cb-0121-435a-94b5-f205476c5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:36.011345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8dc360cb-0121-435a-94b5-f205476c5766 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:36.012470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8dc360cb-0121-435a-94b5-f205476c5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:36.019885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 377/754] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:35 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:36.041394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33b296-e2a8-4a9e-93dc-7c3afa8f450c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:36.052812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33b296-e2a8-4a9e-93dc-7c3afa8f450c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:36.056651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:36.057233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:36.057525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:36.057804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:36.058471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:36.084779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb291fb4-3425-45d2-8ae9-ce2276faa178 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:36.097161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 378/755] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:36 2022] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:38.055999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3dfe-620c-4365-8ea8-4addf3c2b00c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.056488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3dfe-620c-4365-8ea8-4addf3c2b00c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.056591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3dfe-620c-4365-8ea8-4addf3c2b00c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.058196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 378/756] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:38.063173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.064109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.064385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.087233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:38.088360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:38.104590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 379/757] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:38 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:38.126581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3dfe-620c-4365-8ea8-4addf3c2b00c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:38.138047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3dfe-620c-4365-8ea8-4addf3c2b00c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:38.142528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:38.143269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.143555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.143829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.144445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:38.169762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:38.180231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:30:38.181380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 379/758] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:38 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:38.186763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:38.195832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a5bd-9911-4642-9062-53f5c09d0ad1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:38.199849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:38.200427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.200717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.200998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.201671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:38.201969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:38.227884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:38.232390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 380/759] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:38 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:38.237765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:38.247251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7549-25af-4d61-88d5-4b12b16eefcd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:38.251767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:38.252368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.252651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.252925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.253585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:38.253880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:38.279564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:38.284358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 380/760] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:38 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:38.289972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:38.299275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777d17-f6dd-4e5e-8d35-77e4e6f7e035 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:38.303312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:38.303913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.304201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.304483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.305228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] RBAC: Adding query filter params (interface=public, service_id=be6f14bfb5f445fb8a33360d6b899bba, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:38.305532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:38.331845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd0404-672e-4af3-850a-c1428b6de790 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:38.337336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 381/761] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:30:38 2022] GET /identity/v3/endpoints?service_id=be6f14bfb5f445fb8a33360d6b899bba&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:38.342838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:38.351946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011940fd-ae56-41e8-9b75-f9097d2597cf admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:38.355965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:38.356541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:38.356828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:38.357108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:38.357751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:38.383688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d91a5-b801-4c12-98f3-d1580fe3293e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:38.389393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 381/762] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:38 2022] GET /identity/v3/services => generated 1500 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:30:40.321863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d6ca-87f5-43e1-b20d-d0835b7740d9 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.322421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d6ca-87f5-43e1-b20d-d0835b7740d9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.322421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d6ca-87f5-43e1-b20d-d0835b7740d9 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.324071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 382/763] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:40.329201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.329628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.330274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.352290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:40.353416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:40.360029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 382/764] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:40 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:40.381928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d6ca-87f5-43e1-b20d-d0835b7740d9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:40.394010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d6ca-87f5-43e1-b20d-d0835b7740d9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:40.398223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:40.398971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.399266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.399551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.400172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:40.425624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:40.435964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:30:40.437000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 383/765] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:40 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:40.442951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:40.451281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6263c27-80f8-4678-a401-a6729d48f73f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:40.455925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:40.456500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.456786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.457064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.457725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:40.458022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:40.483387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:40.488630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 383/766] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:40 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:40.493841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:40.502902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9b5e-ac32-4bdf-b71a-5d90bdf40315 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:40.506898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:40.507467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.507759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.508044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.508710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:40.509012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:40.534896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3260060-c29b-47dc-87d6-bdcda22122f6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:40.539656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 384/767] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:40 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:40.545008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:40.554776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d2fa6-c6d0-405c-832c-f05181ec5ea6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:40.558725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:40.559290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:40.559577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:40.559859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:40.560534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:40.585350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a16a-3f25-43d6-b7ed-80efff5340a7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:40.602405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 384/768] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:42.569055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b504-a78e-4e48-bf96-ff64a7fc8cf5 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.569579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b504-a78e-4e48-bf96-ff64a7fc8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.569692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370b504-a78e-4e48-bf96-ff64a7fc8cf5 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.571307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 385/769] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:42.576279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.576651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.576850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.599771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:42.600909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:42.617144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 385/770] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:42 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:42.639325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b504-a78e-4e48-bf96-ff64a7fc8cf5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.652334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370b504-a78e-4e48-bf96-ff64a7fc8cf5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.656254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.656970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.657867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.658157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.658825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:42.684414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.697318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:30:42.698392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 386/771] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:42.703924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.713056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bda0b-91a7-4bf8-89e0-950d7842666d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.717083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.717678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.717967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.718251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.718953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:42.719257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:42.744380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d92d1e-5374-4a4b-b5fc-90c949b7a205 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.748893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 386/772] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:42.754551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.764476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d7a74-0be9-401b-9b2e-160e38022fe7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.769111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.769673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.769962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.770240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.770939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:42.771237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:42.796219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21d935-28e2-4fd5-8a26-d66252d633a3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.800414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 387/773] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:44.732874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f33eb-fb42-4c5f-a6bf-3300bf5b3930 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.733493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f33eb-fb42-4c5f-a6bf-3300bf5b3930 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.733493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f33eb-fb42-4c5f-a6bf-3300bf5b3930 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.735144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 387/774] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:44.740214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46ede5-2a9f-465a-a440-f1b8a27f0b9d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.740684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46ede5-2a9f-465a-a440-f1b8a27f0b9d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.740776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46ede5-2a9f-465a-a440-f1b8a27f0b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.763018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-eb46ede5-2a9f-465a-a440-f1b8a27f0b9d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:44.764131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-eb46ede5-2a9f-465a-a440-f1b8a27f0b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:44.771396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 388/775] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:44 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:44.793242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f33eb-fb42-4c5f-a6bf-3300bf5b3930 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:44.804967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f33eb-fb42-4c5f-a6bf-3300bf5b3930 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:44.808879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:44.809461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.809752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.810034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.810747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:44.836866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7b6d4-3dc4-4cf8-9a27-5d6e65ad8bb1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:44.849204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 388/776] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:44 2022] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:46.821799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e80c1b-19cf-459b-a0c1-a34bbc5fac9e None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.822344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e80c1b-19cf-459b-a0c1-a34bbc5fac9e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.822344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e80c1b-19cf-459b-a0c1-a34bbc5fac9e None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.824053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 389/777] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:46.829571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.830004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.830194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.852934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:46.854063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:46.870874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 389/778] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:46 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:46.892725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e80c1b-19cf-459b-a0c1-a34bbc5fac9e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.904697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e80c1b-19cf-459b-a0c1-a34bbc5fac9e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.908755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.909466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.909753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.910028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.910646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:46.936899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.947893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:30:46.948969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 390/779] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:46.955056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.963520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e105-0c79-4602-a8f9-ce173a18d752 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.967522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.968104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.968391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.968668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.969329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:46.969695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:46.995240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:47.000024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 390/780] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:47.006206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:47.015220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d837c-0ddd-4817-a8ff-393ae19a3501 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:47.019425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:47.019997 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:47.020284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:47.020563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:47.021224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:47.021519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:47.047304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:47.052445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 391/781] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:47.057850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:47.067059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4480f-d394-4c49-b834-62f5f65dc836 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:47.071041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:47.071608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:47.071941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:47.072174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:47.072912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] RBAC: Adding query filter params (interface=public, service_id=2e9c7a00bb82411a845210fac30e4a0d, region_id=RegionOne) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:47.073213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:47.098873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62789-307b-44e7-bdfd-47e7ed79fca4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:47.103863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 391/782] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:30:47 2022] GET /identity/v3/endpoints?service_id=2e9c7a00bb82411a845210fac30e4a0d&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:47.108994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:47.119058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d540bb-c003-4225-baf1-bb2befa6fb57 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:47.123097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:47.123673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:47.123965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:47.124250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:47.124900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:47.151133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca5312-180d-4619-b688-4ef8a389a61c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:47.158195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 392/783] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:47 2022] GET /identity/v3/services => generated 1739 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:30:49.104051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe89e-24c4-41ae-86a0-d055e1451204 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.104556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe89e-24c4-41ae-86a0-d055e1451204 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.104674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe89e-24c4-41ae-86a0-d055e1451204 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.106278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 392/784] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:49.111443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.111826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.112013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.133961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:49.135121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:49.142420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 393/785] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:49 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:49.164972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe89e-24c4-41ae-86a0-d055e1451204 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:49.176322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe89e-24c4-41ae-86a0-d055e1451204 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:49.180199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:49.180910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.181215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.181482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.182106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:49.207806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:49.217991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:30:49.219073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 393/786] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:49.225108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:49.233441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7dd61-e794-4e8a-9a19-ec5f75bdab0d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:49.237642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:49.238171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.238458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.238772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.239443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:49.239738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:49.265220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:49.271469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 394/787] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:49.277397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:49.286647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01288e-bca5-4eae-b10f-17ac0c511f86 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:49.290656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:49.291258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.291550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.291833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.292505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:49.292806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:49.318170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a4afa-0a29-45ea-a677-36ac688ce688 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:49.322794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 394/788] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:30:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:49.328015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:49.337608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5a82-732c-47b1-843f-efce46ebcda7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:49.341563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:49.342128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:49.342414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:49.342724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:49.343415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:49.368391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7e23a-bf3c-491e-b621-a178e0e5ec44 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:49.385916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 395/789] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:51.359171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2846c-947e-43b3-adda-80a73b5ed8c5 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.359699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2846c-947e-43b3-adda-80a73b5ed8c5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.360285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2846c-947e-43b3-adda-80a73b5ed8c5 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.362042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 395/790] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:51.367083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.367524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.367636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.391579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:51.393174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:51.415121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 396/791] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:51.437549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2846c-947e-43b3-adda-80a73b5ed8c5 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:51.449608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2846c-947e-43b3-adda-80a73b5ed8c5 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:51.453711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:51.454350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.454641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.454954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.455601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:51.481116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:51.482464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.common [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 08 02:30:51.501670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.sql.core [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 08 02:30:51.501670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 08 02:30:51.501670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [parameters: {'id': '9a45aff2051049bd9d5a1d66986bd294', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 08 02:30:51.501670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:30:51.515527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a45aff2051049bd9d5a1d66986bd294.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a45aff2051049bd9d5a1d66986bd294. Apr 08 02:30:51.516961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 396/792] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Apr 8 02:30:51 2022] POST /identity/v3/projects => generated 262 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:51.523031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:51.531537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b9f6-90c2-49b2-9253-95b9e0d8d5d6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:51.536255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:51.536968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.537254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.537531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.545287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:51.571248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:51.585071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-53912043-9bdb-4a77-8a60-919c3eb4527a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:51.586116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 397/793] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:51.592221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:51.602411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ce67-0757-4a0f-bcec-44ce5aba85f7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:51.606412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:51.607028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.607318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.607598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.608311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:51.608610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:51.635053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831f1e6-054e-4a00-9f5a-158eac0319b7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:51.651386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 397/794] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:30:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:53.626970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05822fc-7eba-45e2-a0eb-754c1b9abdbb None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.627539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05822fc-7eba-45e2-a0eb-754c1b9abdbb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.627539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05822fc-7eba-45e2-a0eb-754c1b9abdbb None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.629188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 398/795] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:53.634326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.634785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.634925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.658487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:53.659994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:53.666735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 398/796] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:53 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:53.690022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05822fc-7eba-45e2-a0eb-754c1b9abdbb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.701321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05822fc-7eba-45e2-a0eb-754c1b9abdbb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.705754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.706334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.706619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.706925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.707569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:53.733520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.734839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.common [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 08 02:30:53.746597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.sql.core [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 08 02:30:53.746597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 08 02:30:53.746597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [parameters: {'user_id': 'f8bb005f23f241108a91546bde70a4a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 08 02:30:53.746597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:30:53.760186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 08 02:30:53.761358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 399/797] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:30:53 2022] POST /identity/v3/users => generated 160 bytes in 72 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:53.767406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.776263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c5d3-ae33-4541-a5c7-29426899aca2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.780450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.781173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.781514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.782284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.794684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:53.820902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.838273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6399c76f-fbe7-4c20-9b8a-6534cc0add6d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:30:53.839346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 399/798] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:53.845640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.856752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8f131-8803-4df4-b97b-c375279a021b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.861310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.861887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.862172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.862449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.863241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:53.863537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:53.888833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654eac-80ca-425c-b9ee-9b8c61cbdb4e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.920642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 400/799] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:55.971900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778a74-a2e5-4246-a56e-04f67d878944 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.972440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778a74-a2e5-4246-a56e-04f67d878944 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.972440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778a74-a2e5-4246-a56e-04f67d878944 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.974130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 400/800] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:55.979432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.979813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.980006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:56.002909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:56.004364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:56.011136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 401/801] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:56.034653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778a74-a2e5-4246-a56e-04f67d878944 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:56.045955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778a74-a2e5-4246-a56e-04f67d878944 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:56.049910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:56.050611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:56.050925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:56.051203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:56.065557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:56.091097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:56.107350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:56.108409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 401/802] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:56.114219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:56.122795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb1a3b-a651-4591-ab32-8371817f4d71 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:56.127556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:56.128135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:56.128424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:56.128702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:56.129384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:56.129682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:56.155611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94101-c245-453d-aa5b-f39423a47ded admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:56.168059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 402/803] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:56.173662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:56.182686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef949a-b2ce-4db0-bc73-ed7f891be4b9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:56.186607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:56.187216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:56.187502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:56.188356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:56.189270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:56.215001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cbc2-0921-4e72-82e6-c3227af0e15f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:56.235673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 402/804] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:30:56 2022] POST /identity/v3/users => generated 249 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:58.221208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fcd7e-9a72-47bc-b30f-e709766a4366 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.221716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fcd7e-9a72-47bc-b30f-e709766a4366 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.221825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fcd7e-9a72-47bc-b30f-e709766a4366 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.223587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 403/805] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:58.228676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.229127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.229315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.252179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:58.253266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:58.260024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 403/806] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:58 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:58.282950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fcd7e-9a72-47bc-b30f-e709766a4366 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.294446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fcd7e-9a72-47bc-b30f-e709766a4366 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.298953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.299662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.299952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.300231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.311114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:30:58.317760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:58.318953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 404/807] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.324821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.333951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2935c-050c-43aa-ae30-d149c23d6b13 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.338091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.338711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.339010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.339298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.340011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:58.340315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.367562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.376519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 404/808] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:58.381978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.391833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09b27-63b4-465e-855a-6aaf90ff4d4f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.395903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.396847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.397144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.397425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.409019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.434396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.452831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:58.455002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 405/809] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.460406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.469455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb69192-3d05-440b-98fb-88491c16d05a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.473428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.474009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.474295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.474574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.475289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:58.475586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.500782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.513047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 405/810] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.518875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.528373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7948c2-ca96-415d-95e4-113dc506092d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.532411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.533119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.533411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.533693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.546014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.571802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.589531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:30:58.590562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 406/811] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.596021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.604964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9124-c715-4476-9399-e564e3973603 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.608959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.610094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.610420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.610809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.611589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:58.611887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.637702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.666002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 406/812] 10.222.0.48 () {56 vars in 1160 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.671299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.680886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ec84b-4d86-4202-88ff-3a20113388a3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.684970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.685526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.685815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.686097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.693697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.720136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.729217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 407/813] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:58.734611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.743513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11667f0-8739-4510-90a6-fc57da57bbe0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.747510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.748212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.748499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.748777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.759914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.786562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.802938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:58.803980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 407/814] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.809196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.817501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba25c3-0766-49ae-abd1-a76037af8906 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.821552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.822123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.822412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.822724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.823403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:58.823699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.849028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.861835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 408/815] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.866943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.876501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71c5b1-57a2-4f54-8bb3-bf0953ed7d50 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.880526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.881221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.881608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.881888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.890536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.916239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.930207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:58.931277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 408/816] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.936648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.946378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fde5-940e-40fa-a6fe-967272b55c19 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.950396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.951004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.951297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.951579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.952320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:58.952623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:58.977998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe37ab-cfdd-4a85-97f1-7ee695b5c124 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.992960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 409/817] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.998921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:59.009040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4256b-d862-4016-8d5a-c8e082fa94a2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:59.013032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:59.013608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:59.013897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:59.014178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:59.014997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=a21543ae332b47c88db79bc1fd6e127e) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:30:59.015303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:30:59.041447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862815-c3cd-4f0b-8aea-b033828518a7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:59.046565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 409/818] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/role_assignments?user.id=a21543ae332b47c88db79bc1fd6e127e&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:00.974037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0399d7f-a34a-4401-900e-bf1d7a9d5e87 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.974581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0399d7f-a34a-4401-900e-bf1d7a9d5e87 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.974581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0399d7f-a34a-4401-900e-bf1d7a9d5e87 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.976301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 410/819] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:00.981430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.981835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.982005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.005718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:01.006883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:01.013711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 410/820] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:00 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:31:01.035720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0399d7f-a34a-4401-900e-bf1d7a9d5e87 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.047535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0399d7f-a34a-4401-900e-bf1d7a9d5e87 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.051491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.052198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.052485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.052763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.064269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:01.070510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:31:01.071579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 411/821] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:01.077232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.085686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66946a5-1ad7-42be-b57d-9fab9ab5f50d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.089708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.090292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.090584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.090901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.091609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:01.091911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.118318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.127067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 411/822] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:01.132367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.142720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6256c-4aa2-4ae5-b528-99974660aa3f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.147117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.147816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.148106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.148387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.159930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.185965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.204940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:01.205992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 412/823] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:01.211670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.220785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e03b2-fc1d-46ee-a8f9-33162002dcad admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.224856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.225380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.225672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.225959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.226645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:01.226979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.253487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.266173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 412/824] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:01.271408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.280702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1263fa-bb92-447b-a387-ee862be067d1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.285317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.286020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.286309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.286588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.299523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.325095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.342441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:31:01.343492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 413/825] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:01.349631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.358607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88062c-fbe4-4fe2-8555-1e8705c46dcd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.363579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.364962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.364962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.364962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.365754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:01.366056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.391847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.420419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 413/826] 10.222.0.48 () {56 vars in 1160 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:01.426474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.435545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124d5b4-8e79-461d-8473-26f799b5f21e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.439676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.440376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.440666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.440947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.452852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.478815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.495737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:01.496772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 414/827] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:01.502091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.511105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22082ed2-8ba3-4d0e-b69c-ff6dd410f9ab admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.515091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.515690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.515976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.516254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.516934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:01.517234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.542723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.554873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 414/828] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:01.559970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.568969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0960-e6da-4281-9f16-4aee8420fcb6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.572969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.573666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.573956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.574242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.583070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.608580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.622823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:01.623844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 415/829] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:31:01.629117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.638059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb73ea-2480-4967-a412-895b7d77912d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.642642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.643243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.643533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.643814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.644551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:01.644851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.670928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae4ffd-6d4c-4a38-bf6a-df0f2fa0574c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.684811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 415/830] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:01.690483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:01.699454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86246d4-17b5-4522-8634-6856bbb8c8fc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:01.704002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:01.704954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:01.705238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:01.705514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/a21543ae332b47c88db79bc1fd6e127e/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:01.725351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=a21543ae332b47c88db79bc1fd6e127e, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:01.751254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7540d-8423-488c-84b7-1adf2c72ed1b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:01.763066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 416/831] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:31:01 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/a21543ae332b47c88db79bc1fd6e127e/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:31:03.733157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261793-6e10-45ab-8d2f-7114cfffbdfb None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:03.733700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261793-6e10-45ab-8d2f-7114cfffbdfb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:03.733792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261793-6e10-45ab-8d2f-7114cfffbdfb None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:03.736471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 416/832] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:03.741645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:03.742062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:03.742204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:03.763924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:03.765044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:03.827464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 417/833] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:03 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:03.849973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261793-6e10-45ab-8d2f-7114cfffbdfb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:03.862729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261793-6e10-45ab-8d2f-7114cfffbdfb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:03.866721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:03.867435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:03.867730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:03.868014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:03.879478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:03.885897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:31:03.886986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 417/834] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:03.893190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:03.901714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dba124-14c8-4382-a826-d5841eb9a947 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:03.905704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:03.906283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:03.906571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:03.906882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:03.907779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:03.908071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:03.933592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:03.942399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 418/835] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:03.947886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:03.957581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dba9c-a048-428b-b791-a282b0ee7b52 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:03.961557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:03.962255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:03.962543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:03.962854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:03.973943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:03.999953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.018020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:04.019189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 418/836] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:31:04.024982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.034037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47b96e-2cc6-499e-9453-ce76c90def26 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.038014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.038593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.038909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.039190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.039868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:04.040163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.066145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.078394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 419/837] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:04.083766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.092829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8996e-982a-4d8a-a1c6-55bab15b0e55 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.096929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.097631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.097921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.098199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.111033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.137152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.154694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:31:04.155742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 419/838] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:04.161680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.170833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc83c7-93eb-4972-a757-c33eee273f79 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.176039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.176627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.176920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.177227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.178015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:04.178319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.205217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.236964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 420/839] 10.222.0.48 () {56 vars in 1160 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:04.242391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.251498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dd866-5f23-4de1-bdce-06974ee5e237 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.255520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.256083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.256374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.256657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.264048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.290162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.299886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 420/840] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:04.305323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.314389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd38c16-8303-4f2b-a3e1-addb11c3960b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.318383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.319121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.319407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.319683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.331049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.356728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.373946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:04.375021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 421/841] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:04.380727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.389294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1b2d-996f-46d4-a736-da89745c0720 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.393903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.394489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.394816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.395103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.395789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:04.396091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.421775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.434123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 421/842] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:04.439529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.448717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abc66d-24f9-46ba-90eb-c8d9865d5595 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.452708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.453405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.453694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.453974 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.462873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.489180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.502392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:04.503446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 422/843] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:04.508884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.518106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c86cb-fd7d-49fb-a0e3-14465ea99f40 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.522305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.522902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.523198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.523478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.524212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:04.524513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.551118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359fe89-9ac4-485b-8292-6260c14739d1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.564016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 422/844] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:04.569884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:04.579125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b169-f1d8-46e5-9d64-64558000f10c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:04.583753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:04.584326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:04.584620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:04.584902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:04.585678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=a21543ae332b47c88db79bc1fd6e127e) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:04.585982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:04.616413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040324-394a-4625-babe-ef56d42ea381 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:04.622155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 423/845] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:04 2022] GET /identity/v3/role_assignments?user.id=a21543ae332b47c88db79bc1fd6e127e&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:06.602460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db090-4157-4e5e-8872-bfb007908a99 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:06.603035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db090-4157-4e5e-8872-bfb007908a99 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:06.603035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db090-4157-4e5e-8872-bfb007908a99 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:06.604708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 423/846] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:06.609829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:06.610266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:06.610401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:06.632965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:06.634102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:06.640789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 424/847] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:06 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:06.662777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8db090-4157-4e5e-8872-bfb007908a99 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:06.674225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8db090-4157-4e5e-8872-bfb007908a99 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:06.678161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:06.678900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:06.679191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:06.679473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] PATH_INFO: `/v3/services/network` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:06.680096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:06.706685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:06.717216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:31:06.718254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 424/848] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:06 2022] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:06.723873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:06.732226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6747c1-9859-4f37-90e2-2cf29e4194c1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:06.736287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:06.736867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:06.737156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:06.737436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:06.738109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] RBAC: Adding query filter params (name=network) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:06.738407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:06.763868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728860e-8876-4900-8f6c-e6748d1b2e7c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:06.768749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 425/849] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:06.774255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:06.783845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d4f-70dc-4ebf-a96d-7d387c9acd8f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:06.787889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:06.788456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:06.788745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:06.789026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:06.789687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:06.789987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:06.816012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d56df-ad40-4a02-9fc5-e9e103fd25e7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:06.820411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 425/850] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:08.772135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a198b77-689c-468f-9f8f-8e5dfff71493 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:08.772712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a198b77-689c-468f-9f8f-8e5dfff71493 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:08.772712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a198b77-689c-468f-9f8f-8e5dfff71493 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:08.774359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 426/851] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:08.779333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7716-0720-49ae-ab2b-781ad3a15a4c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:08.779746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7716-0720-49ae-ab2b-781ad3a15a4c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:08.779898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db7716-0720-49ae-ab2b-781ad3a15a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:08.803329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d0db7716-0720-49ae-ab2b-781ad3a15a4c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:08.804471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d0db7716-0720-49ae-ab2b-781ad3a15a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:08.811144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 426/852] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:08 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:08.832695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a198b77-689c-468f-9f8f-8e5dfff71493 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:08.844170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a198b77-689c-468f-9f8f-8e5dfff71493 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:08.848797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:08.849375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:08.849668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:08.849954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:08.850624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:08.877005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006aa1be-ec02-4a1d-8523-032e2c3fcc9c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:08.890039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 427/853] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:31:08 2022] POST /identity/v3/services => generated 240 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:10.856752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655893-2f1e-43fc-a048-91160fcafdd7 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:10.857321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655893-2f1e-43fc-a048-91160fcafdd7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:10.857321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655893-2f1e-43fc-a048-91160fcafdd7 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:10.859010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 427/854] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:10.864565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:10.865003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:10.865135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:10.887627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:10.888753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:10.905742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 428/855] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:10 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:31:10.927662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655893-2f1e-43fc-a048-91160fcafdd7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:10.939978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655893-2f1e-43fc-a048-91160fcafdd7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:10.943894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:10.944607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:10.944896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:10.945174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:10.945799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:10.971599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:10.981954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:31:10.983037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 428/856] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:10 2022] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:10.989756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:10.998307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e4ce6-b8d4-4a12-996d-56dd71b50288 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:11.002503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:11.003123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:11.003415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:11.003696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:11.004363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:11.004662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:11.029890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:11.035135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 429/857] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:11.040433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:11.050136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01333b75-9748-4c9e-a80c-70e6ae557a64 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:11.054095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:11.054689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:11.054979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:11.055259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:11.055924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:11.056225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:11.081179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:11.085729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 429/858] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:11.091145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:11.100788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796454b4-8801-49dd-a026-44d8794218a4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:11.104771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:11.105338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:11.105634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:11.105915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:11.106656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] RBAC: Adding query filter params (interface=public, service_id=172dde73c7b34291b5d8bc57b911af62, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:11.107033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:11.132338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70587e9-efa5-465a-9bae-9e642cc0cc43 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:11.137372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 430/859] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:31:11 2022] GET /identity/v3/endpoints?service_id=172dde73c7b34291b5d8bc57b911af62&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:11.143180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:11.152353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42074e-79c5-4ae9-b462-347320caff11 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:11.156365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:11.156962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:11.157362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:11.157643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:11.158289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:11.183282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbba7d-726a-4981-9ddb-3f4d8a74e84a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:11.190386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 430/860] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:31:11 2022] GET /identity/v3/services => generated 1967 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:31:13.214562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c8c8-1cf6-41bb-ab25-6c117ea475ff None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.215106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c8c8-1cf6-41bb-ab25-6c117ea475ff None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.215192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959c8c8-1cf6-41bb-ab25-6c117ea475ff None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.216847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 431/861] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:13.223393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.223831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.223974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.254963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:13.256424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:13.264334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 431/862] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:13 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:13.294682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959c8c8-1cf6-41bb-ab25-6c117ea475ff None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:13.307865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959c8c8-1cf6-41bb-ab25-6c117ea475ff None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:13.311993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:13.312839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.313651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.313959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.314587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:13.340489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:13.351328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:31:13.352407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 432/863] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:13 2022] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:13.358551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:13.367137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ccf4-8b6b-49d7-a988-c729f6b7c3cd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:13.371104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:13.371686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.371974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.372254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.372922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:13.373220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:13.399585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:13.404496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 432/864] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:13.410108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:13.419335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893c93b-0856-4e5f-a68f-971ff935e3d5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:13.423464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:13.424072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.424359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.424643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.425312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:13.425612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:13.451205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2475a-1aa8-477a-a452-9355ee88c400 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:13.456487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 433/865] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Apr 8 02:31:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:13.462990 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:13.472613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60edd2-a86b-4d71-ac79-c6d6aa8ee647 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:13.476589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:13.477160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:13.477446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:13.477726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:13.478412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:13.504619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8210f2-7ac2-4935-83af-53775b892bf3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:13.522081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 433/866] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:31:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:15.524445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e444-16db-4136-a286-4f13b63944d7 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:15.525028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e444-16db-4136-a286-4f13b63944d7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:15.525028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e444-16db-4136-a286-4f13b63944d7 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:15.526683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 434/867] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:15.532314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:15.532952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:15.532952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:15.555195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:15.556321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:15.573789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 434/868] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:15.595718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e444-16db-4136-a286-4f13b63944d7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:15.607173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e444-16db-4136-a286-4f13b63944d7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:15.611793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:15.612380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:15.612672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:15.612955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:15.613655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:15.638836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:15.644494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.sql.core [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 08 02:31:15.644494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 08 02:31:15.644494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [parameters: {'id': 'b46487eed9ad44acb0818cf0343d3cc2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 08 02:31:15.644494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66414) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:31:15.650522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 08 02:31:15.651661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 435/869] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:31:15 2022] POST /identity/v3/roles => generated 144 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:15.657928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:15.666355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e59cf-a920-4561-98ee-8cc5d63ea99d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:15.670370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:15.671132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:15.671420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:15.671698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:15.682937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:15.690393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-df629e00-0aba-440e-9486-137e95ab55b1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:31:15.691526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 435/870] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Apr 8 02:31:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:15.696860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:15.706851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aba40-4f5f-4434-88e1-17ee865420a8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:15.710909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:15.711487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:15.711780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:15.712064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:15.712770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:15.713069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:15.738051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c4433-05c7-49b7-b3db-b8a3edd63df0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:15.746435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 436/871] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:17.720361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-fe43-4806-9c4f-e1da459532df None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:17.720919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-fe43-4806-9c4f-e1da459532df None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:17.720919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148cda-fe43-4806-9c4f-e1da459532df None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:17.722581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 436/872] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:17.727692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:17.728078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:17.728267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:17.750105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:17.751769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:17.758449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 437/873] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:17.782375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148cda-fe43-4806-9c4f-e1da459532df None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:17.794643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148cda-fe43-4806-9c4f-e1da459532df None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:17.799025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:17.799735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:17.800024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:17.800305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:17.811128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:17.837766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:17.855460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:17.856509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 437/874] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:17.863125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:17.871652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae68ed-eab1-4f2a-9bd1-92d9860638cc None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:17.875697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:17.876280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:17.876571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:17.876853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:17.877540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:17.877841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:17.903067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07a1bb-5fa2-4586-86b3-5b51bea2e7df admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:17.915905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 438/875] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:17.921277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:17.931037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c1aee-b9e2-46dc-b6c7-da765c78b4dc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:17.935095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:17.935674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:17.935966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:17.936249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:17.936897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:17.962186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a0ec1-502b-45d0-aa76-7b58b56e0d92 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:17.982615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 438/876] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:31:17 2022] POST /identity/v3/users => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:19.942101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2a43-846e-4164-be3e-0740c205690d None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:19.942626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2a43-846e-4164-be3e-0740c205690d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:19.942764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba2a43-846e-4164-be3e-0740c205690d None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:19.944388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 439/877] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:19.949419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:19.949828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:19.949989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:19.973381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:19.974527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:19.981347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 439/878] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:20.003540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2a43-846e-4164-be3e-0740c205690d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.015082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba2a43-846e-4164-be3e-0740c205690d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.019532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.020243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.020528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.020806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.031937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:20.038235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:31:20.039309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 440/879] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:20.044955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.053437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560431ac-70ea-4ffe-8540-1ba548b84c84 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.057481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.058070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.058363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.058647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.059382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.059687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.086137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.094564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 440/880] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:20.099874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.109317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb08a6-c5bb-4e88-9bb0-06f443a7722f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.113453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.114146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.114435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.114740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.126368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.152728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.170307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:20.171500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 441/881] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:20.177379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.187273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f340db-1ce2-4356-98c4-1ee5902e48ed admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.192459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.192993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.193283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.193568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.194256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.194558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.220373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.233783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 441/882] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:20.239716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.249019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc40ed0-3487-4f9f-b8fc-282e51115005 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.254125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.254866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.255152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.255427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.268276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.294350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.312364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:20.313428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 442/883] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:20.318959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.328045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f9e35-e62f-4caf-804d-45f23c1fb418 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.332501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.333088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.333375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.333658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.334443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.334783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.361469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.389297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 442/884] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:20.395205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.404456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04991b-4094-44c2-a202-72206bb83fe7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.408742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.409292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.409577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.409857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.417305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.443451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.452559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 443/885] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:20.458542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.467737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d24c82-2350-40c1-980f-1fd60541b099 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.472466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.473180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.473467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.473744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.484992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.510092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.527282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:20.528329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 443/886] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:20.534463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.542947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de29e2-c7c6-47d4-b602-7c50568eedd3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.547179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.547634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.547925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.548207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.548890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.549193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.574115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.588406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 444/887] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:20.593726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.603429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9182a4-761a-4773-a8ce-8c349ac5c4c2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.607507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.608246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.608541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.608827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.618052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.644186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.657858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:20.658917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 444/888] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:20.664481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.673965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cde44d-790b-4eb8-addd-58b199493a3a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.677987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.678556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.678880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.679161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.679896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.680195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.706132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b9330-c2aa-4c74-8edf-79ebc28ebfd5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.718731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 445/889] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:20.724851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:20.734004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126b86-2278-46f4-93e6-4e6c764d20e2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:20.738877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:20.739445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:20.739741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:20.740027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:20.740806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:20.741112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:20.766772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeacb2-3c8f-46e8-b8b6-fd5043d8023a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:20.772256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 445/890] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:20 2022] GET /identity/v3/role_assignments?user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:22.699465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97618bc-d589-4f2b-9cb9-4dc19e9dcd4a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.700018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97618bc-d589-4f2b-9cb9-4dc19e9dcd4a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.700018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97618bc-d589-4f2b-9cb9-4dc19e9dcd4a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.701692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 446/891] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:22.707443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.707814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.708012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.730601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:22.731764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:22.738510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 446/892] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:22.759782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97618bc-d589-4f2b-9cb9-4dc19e9dcd4a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:22.772010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97618bc-d589-4f2b-9cb9-4dc19e9dcd4a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:22.775918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:22.776624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.776913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.777193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.789056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:22.795473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:31:22.796524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 447/893] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:22.802710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:22.811148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4ce2a-2bb5-4b49-834f-eb3e33e7761e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:22.815270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:22.815863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.816152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.816431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.817139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:22.817438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:22.843008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:22.852111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 447/894] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:31:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:22.857667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:22.867380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d70fd-ca1a-411c-a6fc-9c5a9423037b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:22.871508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:22.872207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.872498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.872780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.883704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:22.910259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:22.927531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:22.928574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 448/895] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:22.934046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:22.943690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402191-b533-416c-9251-de0d12f6d6e2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:22.947879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:22.948467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:22.948761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:22.949048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:22.949789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:22.950042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:22.976296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:22.989706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 448/896] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:22.995273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.004509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f32cb-10f4-4bab-825b-4fcb0a55c99e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.008600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.009311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.009600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.009883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.022599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.049150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.066236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:23.067298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 449/897] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:23.072964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.082307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a0d68-4a15-4f23-9923-5f6f726e04ab admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.086321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.086933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.087223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.087502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.088284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:23.088588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.115329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.145972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 449/898] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:23.151959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.161346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a98bb-aa4e-4d1c-89ea-241b1eca57f1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.165365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.166071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.166362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.166644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.178581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.205009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.221786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:23.222851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 450/899] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:23.228331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.237376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269910-686a-4cc3-830a-7f79ad3c973a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.241394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.241966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.242255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.242537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.243249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:23.243548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.269718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.282407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 450/900] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:23.287797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.296846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f237072-856a-4476-8c5f-45cc0226f021 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.300896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.301596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.301885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.302164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.310925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.337834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.351285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:23.352331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 451/901] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:23.357761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.367362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946401-ee01-494c-9b4a-1b56c9b03e5a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.371400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.371975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.372266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.372547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.373278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:23.373579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.400353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c76a05-19ce-48db-a8f0-e6f89eecf7a9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.413730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 451/902] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:23.419340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:23.428479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd33df-a16e-4e8a-8b31-1a8a9de655a9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:23.432539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:23.433343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:23.433619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:23.433904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/5f1aa7e27de44da2a1dc7fcb1df0b74c/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:23.453063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=5f1aa7e27de44da2a1dc7fcb1df0b74c, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:23.480259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4cdc-a2a3-40d9-aa77-19b4731af741 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:23.493760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 452/903] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:31:23 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/5f1aa7e27de44da2a1dc7fcb1df0b74c/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:31:25.433968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cbd0-ce12-49a1-9510-3b35a4f1b3cc None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.434512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cbd0-ce12-49a1-9510-3b35a4f1b3cc None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.434609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cbd0-ce12-49a1-9510-3b35a4f1b3cc None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.436245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 452/904] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:25.441727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.442137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.442285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.464729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:25.465844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:25.527780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 453/905] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:25.552685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cbd0-ce12-49a1-9510-3b35a4f1b3cc None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.564224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cbd0-ce12-49a1-9510-3b35a4f1b3cc None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.568120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.568836 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.569127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.569411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.580763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:25.587077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:31:25.588140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 453/906] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:25.593656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.602906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe9e76-7df7-480a-b036-8cb4721f151e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.606942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.607531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.607822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.608102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.608814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:25.609112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:25.634237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:25.643106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 454/907] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:25.648716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.658844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899f5d-0b75-4691-832d-1c71ee91b12b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.662889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.663578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.663874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.664158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.675127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:25.700429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:25.719403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:25.721019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 454/908] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:25.726581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.736474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c98a6c-8acd-46d3-931e-46ce966bd77a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.740524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.741105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.741391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.741671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.742351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:25.742649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:25.768659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:25.781266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 455/909] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:25.787369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.796446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa0eb2-7569-41dd-9ee1-2c63a86bf5ff admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.800797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.801492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.801780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.802058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.890952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:25.917595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:25.936647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:25.937722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 455/910] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:25.944262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:25.953659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f734e-55cc-46b8-b4e7-8164694cadc7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:25.959071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:25.959668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:25.959961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:25.960248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:25.961044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:25.961351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:25.987837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.093932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 456/911] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:26.100522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.109650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bac9c-161a-4168-b6f7-c18c1b4f6e31 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.114578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.115167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.115456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.115736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.123085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.148441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.156592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 456/912] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:26.162583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.171649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07fab-90de-4676-807b-64604c2bc217 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.176350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.177048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.177339 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.177620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.188889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.214029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.230870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:26.231911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 457/913] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:26.237921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.246223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603a1d-d392-4206-adb0-3419b4292e6a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.250194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.250798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.251090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.251362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.252034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:26.252330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.277160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.290158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 457/914] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:26.295530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.304745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c76f3-5e4b-4a0f-aa46-6db12c7185e9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.308710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.309397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.309685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.309962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.319235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.344350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.357689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:26.358729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 458/915] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:26.364796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.373748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd046a77-5546-4a06-b411-f2594f14f5d8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.378301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.378900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.379189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.379469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.380202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:26.380502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.406086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e0270-a583-486b-be54-135e5c576352 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.418758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 458/916] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:26.424974 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:26.433922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a4fb5-32d0-42e3-8969-724a9a65c638 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:26.437949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:26.439294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:26.439547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:26.439826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:26.440598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:26.440904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:26.466235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a95064-062c-4c92-b9d7-46ae97ebb46a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:26.471936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 459/917] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:26 2022] GET /identity/v3/role_assignments?user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:28.582610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc004f-366f-4c38-9303-3ea522b52abd None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.583175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc004f-366f-4c38-9303-3ea522b52abd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.583283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc004f-366f-4c38-9303-3ea522b52abd None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.584868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 459/918] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:28.590035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.590438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.590610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.613226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:28.614368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:28.621039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 460/919] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:31:28.643303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc004f-366f-4c38-9303-3ea522b52abd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.654897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc004f-366f-4c38-9303-3ea522b52abd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.658907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.659615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.659906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.660187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.671017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:28.677769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:28.678851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 460/920] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:28.684237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.692759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d87e9f-d0dc-4f1c-a24d-e7c2c4296027 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.696751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.697330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.697618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.697898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.698607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:28.698936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:28.724908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:28.733228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 461/921] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:28.738771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.748245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62a75-2327-4ab6-86af-598664cf3a19 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.752369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.753063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.753352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.753632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.764454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:28.791127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:28.808172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:28.809213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 461/922] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:28.814873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.823923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e70be5-d1f5-494f-ad8b-7971ea5b59e4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.828054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.828630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.829428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.829713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.830397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:28.830731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:28.856166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:28.868597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 462/923] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:28.873859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.882992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8a80-4921-442f-909b-7d5c1de69383 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.887001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.887700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.887989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.888267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.901399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:28.927610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:28.945180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:28.946222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 462/924] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:28.951677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:28.961009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c24248-7034-4ac2-a9f5-6f832759a45c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:28.965032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:28.965613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:28.965898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:28.966174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:28.966986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:28.967284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:28.994016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.024044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 463/925] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:29.029770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.039015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7007d-99b0-4d47-8eb5-3b490e427c5d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.043033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.043602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.043890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.044170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.051716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.077368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.087212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 463/926] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:31:29.092656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.101734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966f86e-5648-42f5-a416-befe1ff1714e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.105829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.106581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.106856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.107138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.118302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.144391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.161459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:29.162498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 464/927] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:29.167872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.176264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84199860-b2d5-4296-9cd7-219b72e5ddee admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.180331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.180909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.181214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.181479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.182162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:29.182461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.209009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.220801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 464/928] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:29.226009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.234948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ce3c0-2aad-46d6-9dd9-cf32e2d835b3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.239045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.239736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.240020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.240298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.248912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.275603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.289041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:29.290062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 465/929] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:29.295398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.304624 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3df14-f2c8-4a36-a1aa-66823cf7fb66 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.308650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.309229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.309522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.309806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.310543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:29.310873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.337043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9e5df-e70f-45c9-b46f-fd55dd1704aa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.349752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 465/930] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:29.355472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:29.365281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200c2c5-6e5f-4e53-99a2-37c84b8a8ef5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:29.369297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:29.369862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:29.370150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:29.370429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:29.371246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:29.371553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:29.398746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7251f-e8e0-49eb-968b-b984c902847e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:29.404090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 466/931] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:29 2022] GET /identity/v3/role_assignments?user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:31.327464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ee3a-0ce8-4bd7-be8e-0e7b01b20c11 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.327979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ee3a-0ce8-4bd7-be8e-0e7b01b20c11 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.327979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ee3a-0ce8-4bd7-be8e-0e7b01b20c11 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.329731 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 466/932] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:31.334901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.335334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.335465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.358234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:31.359381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:31.366586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 467/933] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:31.388092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6ee3a-0ce8-4bd7-be8e-0e7b01b20c11 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.399773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6ee3a-0ce8-4bd7-be8e-0e7b01b20c11 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.403687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.404389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.404679 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.404960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.416241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:31.423219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:31.424366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 467/934] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:31.429843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.438214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad278b16-1910-4c96-a20a-f2e7ce8e1352 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.442312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.443008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.443298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.443575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.444281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:31.444576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.470510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.478801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 468/935] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:31.483999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.493835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cde42-53c6-4b4f-b8ec-e10abf4e91dc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.497808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.498499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.498825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.499106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.510559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.536904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.554370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:31.555425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 468/936] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:31.561120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.570146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b297-2b7a-4749-8a84-b6bf1deda681 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.574146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.574740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.575025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.575302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.575973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:31.576265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.602200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.614547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 469/937] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:31.619799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.629005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5e7a-85c8-488e-8bf5-ad21c00713ca admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.633033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.633734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.634025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.634307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.647659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.673569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.690603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:31.691663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 469/938] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:31.697043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.706503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec6490-5b5e-4a27-8548-1cc41f79dc0b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.710507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.711126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.711412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.711689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.712465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:31.712763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.739256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.769586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 470/939] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:31.775202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.784485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437706-1d0e-42d7-adda-a150ba543faa admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.788683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.789389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.789674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.789957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.803350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.828900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.845072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:31.846107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 470/940] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:31:31.851431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.861012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71378241-4c46-46e7-8d01-1c739f4680ba admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.864996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.865565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.865851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.866127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.866844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:31.867139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.892312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.904784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 471/941] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:31.910358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.919345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d2bd-729c-49da-8084-387dada33113 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.923909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.924631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.924920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.925201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.934031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:31.959670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:31.973561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:31.974629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 471/942] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:31.980221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:31.990106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e48c-d080-4b9c-896f-6ec33c3c4aad admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:31.994109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:31.994702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:31.994993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:31.995269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:31.996003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:31.996301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:32.021923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1702696-7ef7-4584-bda0-88b0f8838c05 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:32.035279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 472/943] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:32.040906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:32.050657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75545ad6-a3cc-4492-9dea-266fc17c2d7c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:32.054708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:32.055507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:32.055795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:32.056076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/5f1aa7e27de44da2a1dc7fcb1df0b74c/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:32.057799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=5f1aa7e27de44da2a1dc7fcb1df0b74c, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:32.084247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c3f7d-6bd5-4a1a-9db0-b412bd517b27 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:32.096804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 472/944] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:31:32 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/5f1aa7e27de44da2a1dc7fcb1df0b74c/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:31:34.037795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea0bb-17a9-4301-9e14-c56a29c3d1d3 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.038280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea0bb-17a9-4301-9e14-c56a29c3d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.038370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea0bb-17a9-4301-9e14-c56a29c3d1d3 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.040055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 473/945] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:34.045037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.045428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.045943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.067624 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:34.068758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:34.130567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 473/946] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:34.153458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea0bb-17a9-4301-9e14-c56a29c3d1d3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.166082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea0bb-17a9-4301-9e14-c56a29c3d1d3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.170029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.170765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.171058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.171340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.182911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:34.189663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:34.190746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 474/947] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:34.196261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.205248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b6cb-4ad1-45f2-854e-ae75077d2bd7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.209338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.209922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.210213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.210499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.211304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.211605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.236669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.244970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 474/948] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:34.250246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.260245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85588d-ee72-4b55-a8d2-3e11d22b2d01 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.264300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.264982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.265266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.265542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.277741 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.303035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.320482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:34.321512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 475/949] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:34.326890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.336046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c26f4-a90b-4abe-9bfa-44bb91a9c29b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.340121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.340693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.340982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.341264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.341946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.342253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.368368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.381021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 475/950] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:34.386474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.396420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfde59-e63c-49e7-8ec5-1160e8984bc1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.400643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.401344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.401637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.401922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.415303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.442539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.460858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:31:34.461907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 476/951] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:34.467347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.476604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c14288-1583-4728-8880-852602300c3d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.480666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.481283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.481575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.481855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.482631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.482966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.508820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.537423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 476/952] 10.222.0.48 () {56 vars in 1156 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:34.543300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.552520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8b4ce-d429-44dc-bdc4-82376622f623 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.556580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.557146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.557436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.557715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.565770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.591726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.600925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 477/953] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:34.606470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.616095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbba4-463a-49a0-b222-e553679ffa36 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.620117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.620820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.621107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.621382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.633234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.658714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.675463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:31:34.676511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 477/954] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:34.681973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.691147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fbbec-0823-4b18-94d6-d18a86e3a739 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.695220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.695801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.696089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.696371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.697055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.697356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.722431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.735332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 478/955] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:34.740651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.749828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c81a-9a2b-420f-a6ef-fb25b23e7c90 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.754566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.755312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.755604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.755889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.764713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.790298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.804355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:31:34.805401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 478/956] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:31:34.811000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.820572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44533f-05d3-48dd-9148-ad9ec317e7aa admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.824583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.825163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.825443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.825723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.826455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.826793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.851861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7aa14-3618-4b17-a7b4-531ffb0a11ab admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.865188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 479/957] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:34.870752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:34.880429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1544a-4041-4def-8995-9b1215b861a9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:34.884662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:34.885235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:34.885526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:34.885810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:34.886588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:34.886926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:34.912655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dac8d-7cc2-4ca6-bdac-503945882f9c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:34.918334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 479/958] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:34 2022] GET /identity/v3/role_assignments?user.id=5f1aa7e27de44da2a1dc7fcb1df0b74c&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:36.876473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464401-9c24-4ddd-8810-b4b38058e5a3 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:36.877026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464401-9c24-4ddd-8810-b4b38058e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:36.877026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464401-9c24-4ddd-8810-b4b38058e5a3 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:36.878711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 480/959] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:36.883974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:36.884425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:36.884544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:36.907979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:36.909099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:36.915783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 480/960] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:36.937081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464401-9c24-4ddd-8810-b4b38058e5a3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:36.948650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464401-9c24-4ddd-8810-b4b38058e5a3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:36.952541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:36.953258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:36.954061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:36.954338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:36.954983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:36.980295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:36.991001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:31:36.992057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 481/961] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:31:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:36.997887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:37.006438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9d91-0f90-4574-8b36-ac6035cc0662 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:37.010464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:37.011082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:37.011370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:37.011650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:37.012315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:37.012615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:37.038467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3b15-1b1e-4c23-9428-c4b4a88a35ca admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:37.043179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 481/962] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:37.049207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:37.058217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abb40-a477-4193-9cbc-c3f6c1531872 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:37.062188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:37.062791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:37.063682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:37.063964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:37.064630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:37.064926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:37.089754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe4b8b-e1c6-4837-880b-182765b00e38 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:37.093885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 482/963] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:39.032650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2dfd5-e5f3-427e-b880-07ea73586600 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:39.033112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2dfd5-e5f3-427e-b880-07ea73586600 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:39.033215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2dfd5-e5f3-427e-b880-07ea73586600 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:39.034914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 482/964] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:39.040008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438c06-1829-4e82-bc2d-d61a2639a2ae None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:39.040385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438c06-1829-4e82-bc2d-d61a2639a2ae None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:39.040580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438c06-1829-4e82-bc2d-d61a2639a2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:39.062311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a6438c06-1829-4e82-bc2d-d61a2639a2ae None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:39.063947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a6438c06-1829-4e82-bc2d-d61a2639a2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:39.070536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 483/965] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:39.092237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2dfd5-e5f3-427e-b880-07ea73586600 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:39.103840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2dfd5-e5f3-427e-b880-07ea73586600 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:39.107758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:39.108334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:39.108623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:39.108906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:39.110066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:39.135799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc598-5188-40fd-a1f8-ca588e52b233 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:39.148479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 483/966] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:31:39 2022] POST /identity/v3/services => generated 241 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:31:41.101443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7880-68e3-4f7f-bc14-839f56a35d49 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.101951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7880-68e3-4f7f-bc14-839f56a35d49 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.102061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d7880-68e3-4f7f-bc14-839f56a35d49 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.103693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 484/967] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:41.108801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.109176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.109378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.131980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:41.133115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:41.150531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 484/968] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:41.171877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7880-68e3-4f7f-bc14-839f56a35d49 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:41.183293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d7880-68e3-4f7f-bc14-839f56a35d49 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:41.187146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:41.188448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.188757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.189041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.189656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:41.214754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:41.225775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:31:41.226919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 485/969] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:31:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:41.232922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:41.242260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac402470-e2a9-4f40-abfb-09caea80eda7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:41.246256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:41.246879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.247175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.247458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.248131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:41.248429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:41.274703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:41.279505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 485/970] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:41.285611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:41.294766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a1864-81a8-462b-8932-b66fa021be3a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:41.299892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:41.300468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.300761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.301046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.301714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:41.302016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:41.326802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:41.331957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 486/971] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:41.337315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:41.347016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a97824-3194-4dae-a8d7-01f6d4240818 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:41.351062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:41.351627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.351917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.352198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.352928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] RBAC: Adding query filter params (interface=public, service_id=4bcae98ee6e847c7a9a4ba3580e63fc5, region_id=RegionOne) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:41.353233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:41.378095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc37-3499-49ed-8b9f-330c0085522a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:41.383178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 486/972] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:31:41 2022] GET /identity/v3/endpoints?service_id=4bcae98ee6e847c7a9a4ba3580e63fc5&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:41.388358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:41.398123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4103a-28ba-4447-8442-4aeb16156abd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:41.402171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:41.402772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:41.403066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:41.403351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:41.403992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:41.429564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1239d6-ef3c-4a3f-8a6c-bf73b2ac9142 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:41.436178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 487/973] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:31:41 2022] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:31:43.368787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6291-67e0-493b-b58b-f4354c146d93 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.369297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6291-67e0-493b-b58b-f4354c146d93 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.369413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6291-67e0-493b-b58b-f4354c146d93 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.371036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 487/974] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:43.376249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.376641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.376842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.398892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:43.400014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:43.407286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 488/975] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:43.429224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6291-67e0-493b-b58b-f4354c146d93 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:43.440669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6291-67e0-493b-b58b-f4354c146d93 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:43.444562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:43.445273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.445557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.445834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.446454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:43.472141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:43.482514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:31:43.483570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 488/976] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:31:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:43.489692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:43.498119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0f01-cbae-4df2-8798-65bc2d80855c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:43.502844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:43.503440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.503733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.504019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.504697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:43.504999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:43.532643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:43.537921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 489/977] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:43.543644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:43.554049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9052-64dd-47ea-97bd-bc65a620cfe9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:43.558118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:43.558732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.559030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.559315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.559988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:43.560290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:43.590544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c7be-a874-4c8a-92c5-9188b39d0709 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:43.596439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 489/978] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:43.601918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:43.611058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2c711-0aa3-46ff-9ba6-45d86b992cbb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:43.615153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:43.615729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:43.616021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:43.616303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:43.616999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:43.642562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcddec8-d8d8-4bd7-bc0c-fcf38e9eb798 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:43.660611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 490/979] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:31:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:45.599751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadfcf-a6d4-47f0-bd26-03fe63547c3a None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.600376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadfcf-a6d4-47f0-bd26-03fe63547c3a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.600376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddadfcf-a6d4-47f0-bd26-03fe63547c3a None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.601959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 490/980] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:45.606935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.607359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.607506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.629861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:45.631026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:45.648556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 491/981] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:31:45.669598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadfcf-a6d4-47f0-bd26-03fe63547c3a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:45.681096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddadfcf-a6d4-47f0-bd26-03fe63547c3a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:45.685108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:45.685823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.686112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.686395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.687054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:45.713497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:45.724715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:31:45.725758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 491/982] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:31:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:45.731453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:45.739865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f1d03-37c2-405e-8423-d68c687f51be None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:45.743946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:45.744529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.744844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.745126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.745799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:45.746100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:45.771767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:45.776525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 492/983] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:45.781896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:45.793219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fba0a-0825-471a-b86a-2eef1a87ef80 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:45.797256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:45.797824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.798109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.798385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.799786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:45.800083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:45.825482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:45.830132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 492/984] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:45.835685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:45.844627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0459550-1a90-4062-a459-3569a1a50b6e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:45.848731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:45.849294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.849582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.849908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.850598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] RBAC: Adding query filter params (interface=admin, service_id=4bcae98ee6e847c7a9a4ba3580e63fc5, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:45.850931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:45.878019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f124ab3-d20e-47c8-96dd-dc80d772d622 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:45.883352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 493/985] 10.222.0.48 () {56 vars in 1270 bytes} [Fri Apr 8 02:31:45 2022] GET /identity/v3/endpoints?service_id=4bcae98ee6e847c7a9a4ba3580e63fc5&interface=admin®ion_id=RegionOne => generated 193 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:45.888913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:45.898323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2995eb-2405-42f9-a7ea-fc9f3e5162c2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:45.902330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:45.902937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:45.903227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:45.903504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:45.904146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:45.929932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b53cde-5983-4a9e-a970-5dda8563ccc9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:45.936525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 493/986] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:31:45 2022] GET /identity/v3/services => generated 2196 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:31:47.885283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5832-c0c1-42de-9492-4882ea87b53c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:47.885842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5832-c0c1-42de-9492-4882ea87b53c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:47.885842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5832-c0c1-42de-9492-4882ea87b53c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:47.887554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 494/987] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:47.893142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:47.893587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:47.893718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:47.917136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:47.918283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:47.926250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 494/988] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:47.948452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5832-c0c1-42de-9492-4882ea87b53c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:47.960021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5832-c0c1-42de-9492-4882ea87b53c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:47.963926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:47.964646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:47.964934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:47.965214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:47.965831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:47.992102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:48.003241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:31:48.004319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 495/989] 10.222.0.48 () {56 vars in 1147 bytes} [Fri Apr 8 02:31:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:48.010284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:48.019453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a648a-140f-48e7-b498-b48b18b984c0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:48.023763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:48.024344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:48.024630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:48.024909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:48.025575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:48.025871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:48.051902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:48.056659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 495/990] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:48.062074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:48.071135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc0262-c542-477c-b3d1-677282ba5ea8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:48.075143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:48.075707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:48.075994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:48.076272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:48.076930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:48.077224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:48.103117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb6a2a-025e-4653-9c5d-14f04c111706 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:48.107629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 496/991] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Apr 8 02:31:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:48.113032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:48.121924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a3a96-3760-4ee5-bc6b-87c9f24005f2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:48.125938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:48.126501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:48.127006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:48.127390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:48.128069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:48.153872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0be0-d5db-4779-aaa1-85c819e364d3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:48.168280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 496/992] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:31:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:50.122517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98055-abb7-4a5d-97b9-cd5251dcb4b5 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:50.123065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98055-abb7-4a5d-97b9-cd5251dcb4b5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:50.123257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98055-abb7-4a5d-97b9-cd5251dcb4b5 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:50.124938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 497/993] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:50.130447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:50.130909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:50.131038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:50.153756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:50.154926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:50.171928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 497/994] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:50 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:31:50.194085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b98055-abb7-4a5d-97b9-cd5251dcb4b5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:50.206157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b98055-abb7-4a5d-97b9-cd5251dcb4b5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:50.210099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:50.210834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:50.211125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:50.211408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:50.212465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:50.237964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1b1e8-2e7e-4f68-8ec5-d84d24e0a894 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:50.239361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 498/995] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:50.244754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:50.253810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506f8e6-9a31-4f80-8d10-ed6708d0528a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:50.257877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:50.258452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:50.258773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:50.259053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:50.259711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:50.286082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff18e8-f890-4369-9930-32840e64c3d5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:50.312667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 498/996] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:31:50 2022] POST /identity/v3/projects => generated 311 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:31:52.289682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa315-c1ee-46ec-b07c-4d3cd0395828 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:52.290203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa315-c1ee-46ec-b07c-4d3cd0395828 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:52.290203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa315-c1ee-46ec-b07c-4d3cd0395828 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:52.291878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 499/997] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:52.296839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:52.297206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:52.297405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:52.319418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:52.320548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:52.382533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 499/998] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:52.405626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa315-c1ee-46ec-b07c-4d3cd0395828 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:52.417753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa315-c1ee-46ec-b07c-4d3cd0395828 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:52.421737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:52.422445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:52.422773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:52.423059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:52.424886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:52.451310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff64e3-4e70-4d5f-9e2b-569becccec7a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:52.452793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 500/999] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:52.458517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:52.467994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bbf39-8657-4b9e-a66c-cdd3c02ec606 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:52.472878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:52.473467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:52.473754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:52.474032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:52.474687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:52.500796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834f047-57da-4b92-870c-f324c3416abb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:52.520199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 500/1000] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:31:52 2022] POST /identity/v3/users => generated 285 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:54.511540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664323-8274-4ed3-812f-4e833d3da65c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.512094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664323-8274-4ed3-812f-4e833d3da65c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.512094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664323-8274-4ed3-812f-4e833d3da65c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.513766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 501/1001] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:54.518948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.519329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.519522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.542307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:54.543483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:54.551124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 501/1002] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:54 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:54.573171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664323-8274-4ed3-812f-4e833d3da65c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.585007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664323-8274-4ed3-812f-4e833d3da65c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.588900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.589606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.589893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.590172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.603809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:54.609994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:54.611812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 502/1003] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:54.617476 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.626018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da7e6-f20c-4b52-9002-dcf6cdb50ec3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.630374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e568-703d-4364-a794-624a934be700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.630997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e568-703d-4364-a794-624a934be700 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.631290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e568-703d-4364-a794-624a934be700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.631573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e568-703d-4364-a794-624a934be700 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.632285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e568-703d-4364-a794-624a934be700 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:54.632587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e568-703d-4364-a794-624a934be700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:54.659047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e568-703d-4364-a794-624a934be700 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:54.667477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 502/1004] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:54.673099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.682911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69388f75-b37b-41d7-8c26-74c511fb190b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.686959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.687730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.688014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.688289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] PATH_INFO: `/v3/users/a1a0f3787fa142a189f08f05be5af904` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.706073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a1a0f3787fa142a189f08f05be5af904)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:54.731831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:54.733299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 503/1005] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/users/a1a0f3787fa142a189f08f05be5af904 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:54.739733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e568-703d-4364-a794-624a934be700 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.748849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e568-703d-4364-a794-624a934be700 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.753214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.753782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.754074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.754357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.761804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:54.788375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:54.796675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 503/1006] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:31:54.802226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.811210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c29-2ddf-448c-8d1b-be0b5f65a8c4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.815267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.816029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.816316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.816595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.817652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:54.843405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa65f1-9cc1-4cd6-bc8f-ff24a2274c00 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:54.844878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 504/1007] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:54.850509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:54.858832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6278381-636e-4e1d-bdc5-dbf28a2fb8ec admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:54.879304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:54.879873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:54.880164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:54.880477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:54.881317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=ff0558a11bf94e0e99800216ec872b33, user.id=a1a0f3787fa142a189f08f05be5af904) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:54.881627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:54.907161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97817-b354-4301-b593-d7d524372e54 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:54.912734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 504/1008] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:54 2022] GET /identity/v3/role_assignments?user.id=a1a0f3787fa142a189f08f05be5af904&scope.project.id=ff0558a11bf94e0e99800216ec872b33&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:56.906043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c081a-c7cb-4180-ab40-58b4adc05359 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:56.906617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c081a-c7cb-4180-ab40-58b4adc05359 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:56.906617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c081a-c7cb-4180-ab40-58b4adc05359 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:56.909475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 505/1009] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:56.914524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:56.914993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:56.915108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:56.937670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:56.938889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:56.945613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 505/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:56 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:56.967172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c081a-c7cb-4180-ab40-58b4adc05359 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:56.979162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c081a-c7cb-4180-ab40-58b4adc05359 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:56.983096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:56.983967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:56.984066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:56.984328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:56.995887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:57.002120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:57.003216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 506/1011] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:57.008910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:57.018135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097476-ca6c-402b-9d8a-0c03ca838c4b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:57.022402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:57.023020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:57.023312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:57.023593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:57.024298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:57.024597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:57.050964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:57.059203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 506/1012] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:57.065291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:57.075201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f396d-4d14-4be2-b120-d539e183e0c8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:57.079277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:57.080149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:57.080437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:57.080716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] PATH_INFO: `/v3/users/a1a0f3787fa142a189f08f05be5af904` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:57.081788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] RBAC: Authorizing `identity:get_user(user_id=a1a0f3787fa142a189f08f05be5af904)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:57.107095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:57.108627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 507/1013] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:57 2022] GET /identity/v3/users/a1a0f3787fa142a189f08f05be5af904 => generated 285 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:57.114519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:57.123582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f839351-db2f-4535-8eb3-b6a6dc5659d4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:57.128578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:57.129351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:57.129646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:57.129932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:57.131049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:57.156852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913962e-14ed-4475-9f0b-fac00ac5c595 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:57.158306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 507/1014] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:57 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:57.163638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:57.172772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37084dfa-7f66-4216-ad0b-9adba207c4fc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:57.177843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:57.178633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:57.178956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:57.179244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33/users/a1a0f3787fa142a189f08f05be5af904/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:57.181005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0558a11bf94e0e99800216ec872b33, user_id=a1a0f3787fa142a189f08f05be5af904, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:57.208580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c4615-a2f2-468e-8af5-f72b2afb4c0c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:57.221449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 508/1015] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:31:57 2022] PUT /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33/users/a1a0f3787fa142a189f08f05be5af904/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:31:59.249461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9fdc-2a96-4520-9e3d-dcc2cfe3b218 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.249972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9fdc-2a96-4520-9e3d-dcc2cfe3b218 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.249972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9fdc-2a96-4520-9e3d-dcc2cfe3b218 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.252348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 508/1016] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:59.257457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.257880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.258053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.280804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:59.281926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:59.343494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 509/1017] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:59.366191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9fdc-2a96-4520-9e3d-dcc2cfe3b218 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.378324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9fdc-2a96-4520-9e3d-dcc2cfe3b218 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.382267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.383013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.383312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.383597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.395370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:31:59.401906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:59.402999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 509/1018] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:59.408607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.417000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e56b-e8a0-41c1-8f71-0ecd01ab4da6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.421074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.421665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.421954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.422234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.423483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:59.423777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:59.449370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:59.457981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 510/1019] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:59.463465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.472523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3cbd1-76d5-4975-9a94-a8257b34450f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.476614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.477393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.477685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.477968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] PATH_INFO: `/v3/users/a1a0f3787fa142a189f08f05be5af904` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.479096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] RBAC: Authorizing `identity:get_user(user_id=a1a0f3787fa142a189f08f05be5af904)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:59.505735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:59.507220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 510/1020] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/users/a1a0f3787fa142a189f08f05be5af904 => generated 285 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:59.512534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.522468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f2ba-427d-498f-9f4a-3e33598a40ab admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.526527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.527129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.527420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.527703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.535843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:59.561075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:59.569498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 511/1021] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:59.574973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.584410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc84263-f6fb-42f9-a4eb-f54f6868d49d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.588461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.589222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.589510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.589794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.590883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:59.616886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92b7b0-93ec-4dce-983c-2834be64dcb1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:59.618376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 511/1022] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:59.623714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:59.632575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fa317-3f3d-4659-be07-c7cf2defd327 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:59.636662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:59.637218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:59.637503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:59.637780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:59.638541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=ff0558a11bf94e0e99800216ec872b33, user.id=a1a0f3787fa142a189f08f05be5af904) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:31:59.638874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:31:59.664630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c61cf-1569-4f47-9685-19a8d01dd64c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:59.670156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 512/1023] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:59 2022] GET /identity/v3/role_assignments?user.id=a1a0f3787fa142a189f08f05be5af904&scope.project.id=ff0558a11bf94e0e99800216ec872b33&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:01.656622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230c2a-3bc7-4806-8e19-00192588ca63 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:01.657151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230c2a-3bc7-4806-8e19-00192588ca63 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:01.657247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230c2a-3bc7-4806-8e19-00192588ca63 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:01.659087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 512/1024] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:01.664126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:01.664504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:01.664701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:01.687231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:01.688364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:01.695864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 513/1025] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:01 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:01.718672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230c2a-3bc7-4806-8e19-00192588ca63 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:01.730176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230c2a-3bc7-4806-8e19-00192588ca63 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:01.734057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:01.734787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:01.735077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:01.735871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:01.740874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:01.766521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeffdd-0d50-487d-a90b-04f5075e909f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:01.768036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 513/1026] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:01.773682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:01.782286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f762217-b44f-4991-936c-24a6989eba5c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:01.786504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:01.787127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:01.787419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:01.787702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:01.788361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:01.814632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f5e88-4bfe-41d6-8d31-acb4de23597a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:01.833087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 514/1027] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:32:01 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:32:03.817974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b877a7-8dbc-436a-9473-fb2a4cc52bed None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:03.818536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b877a7-8dbc-436a-9473-fb2a4cc52bed None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:03.818536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b877a7-8dbc-436a-9473-fb2a4cc52bed None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:03.820232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 514/1028] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:03.825269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282990-a655-49bf-990f-02930ff046d0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:03.825668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282990-a655-49bf-990f-02930ff046d0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:03.825847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53282990-a655-49bf-990f-02930ff046d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:03.847864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-53282990-a655-49bf-990f-02930ff046d0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:03.848998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-53282990-a655-49bf-990f-02930ff046d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:03.855773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 515/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:03.880628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b877a7-8dbc-436a-9473-fb2a4cc52bed None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:03.892345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b877a7-8dbc-436a-9473-fb2a4cc52bed None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:03.896550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:03.897320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:03.897609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:03.897889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] PATH_INFO: `/v3/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:03.899257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:03.924520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:32:03.924520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:32:03.924520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:32:03.925466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:03.926848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 515/1030] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:03 2022] GET /identity/v3/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:03.932203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282990-a655-49bf-990f-02930ff046d0 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:03.941422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53282990-a655-49bf-990f-02930ff046d0 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:03.945512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:03.946307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:03.946595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:03.946907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] PATH_INFO: `/v3/users/d51809c85b7141c49fafe7823480e54e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:03.965169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] RBAC: Authorizing `identity:get_user(user_id=d51809c85b7141c49fafe7823480e54e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:03.991378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:03.992913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 516/1031] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:03 2022] GET /identity/v3/users/d51809c85b7141c49fafe7823480e54e => generated 286 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:03.998531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:04.007963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6629c6-5441-4edf-ae6f-8ca0a0f87066 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:04.012171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:04.012737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:04.013025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:04.013305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:04.021637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:04.047355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:04.056199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 516/1032] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:03 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:04.061755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:04.071436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f07-4c26-418b-8f59-f8738784b215 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:04.075475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:04.076239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:04.076530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:04.076811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:04.077916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:04.103653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88358f2-c223-44f0-abf8-62f52e3bbe40 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:04.105145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 517/1033] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:04 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:04.111527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:04.119892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4080-3cf0-4006-8512-dcfd100362e0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:04.123954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:04.124519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:04.124808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:04.125088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:04.125891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=ff0558a11bf94e0e99800216ec872b33, user.id=d51809c85b7141c49fafe7823480e54e) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:04.126807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:04.152434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3edb5b-7aa4-415a-8663-87b76e9f1dbd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:04.158124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 517/1034] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:04 2022] GET /identity/v3/role_assignments?user.id=d51809c85b7141c49fafe7823480e54e&scope.project.id=ff0558a11bf94e0e99800216ec872b33&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:06.070500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0ad7-1b1a-4845-9555-7372a7d727b5 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.071032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0ad7-1b1a-4845-9555-7372a7d727b5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.071173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0ad7-1b1a-4845-9555-7372a7d727b5 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.072768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 518/1035] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:06.077697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.078138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.078244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.101371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:06.102507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:06.109249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 518/1036] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:06 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:06.131258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0ad7-1b1a-4845-9555-7372a7d727b5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:06.143905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0ad7-1b1a-4845-9555-7372a7d727b5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:06.148202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:06.148986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.149273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.149549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] PATH_INFO: `/v3/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.150909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:06.175906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:32:06.175906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:32:06.175906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:32:06.176776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:06.178040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 519/1037] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:06 2022] GET /identity/v3/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:06.183851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:06.192934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b913-b4c1-4f69-9be7-17fb67f407e1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:06.197133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:06.197927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.198219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.198501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] PATH_INFO: `/v3/users/d51809c85b7141c49fafe7823480e54e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.199644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] RBAC: Authorizing `identity:get_user(user_id=d51809c85b7141c49fafe7823480e54e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:06.227469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:06.228916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 519/1038] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:06 2022] GET /identity/v3/users/d51809c85b7141c49fafe7823480e54e => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:06.234189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:06.243302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962118-b154-4b84-8e0b-66e6a6bea618 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:06.247284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:06.248044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.248330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.248609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.249666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:06.275608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d15d5-b482-4092-974b-6aec5749d4b8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:06.277081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 520/1039] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:06 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:06.283508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:06.292593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e397b0-dd65-4bb5-9c53-bcc1ff59c82e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:06.296727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:06.297519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:06.298257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:06.298556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33/users/d51809c85b7141c49fafe7823480e54e/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:06.300609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0558a11bf94e0e99800216ec872b33, user_id=d51809c85b7141c49fafe7823480e54e, role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:06.326957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a52f-e1ca-472b-b299-e75043251c55 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:06.340953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 520/1040] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:32:06 2022] PUT /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33/users/d51809c85b7141c49fafe7823480e54e/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:32:08.276203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219c81-48c1-408b-a33a-777dfa13d878 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.276739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219c81-48c1-408b-a33a-777dfa13d878 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.276739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb219c81-48c1-408b-a33a-777dfa13d878 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.278368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 521/1041] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:08.283498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.283890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.284075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.306653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:08.307817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:08.371606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 521/1042] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:08 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:32:08.394286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219c81-48c1-408b-a33a-777dfa13d878 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:08.406093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb219c81-48c1-408b-a33a-777dfa13d878 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:08.410410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:08.411218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.411508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.411791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] PATH_INFO: `/v3/roles/bc097fad0c624faf8db8ee926f98f9e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.413103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097fad0c624faf8db8ee926f98f9e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:08.439423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:08.440644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 522/1043] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:08 2022] GET /identity/v3/roles/bc097fad0c624faf8db8ee926f98f9e0 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:08.446107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:08.454724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613373-971e-4805-8ef9-ef5d8bd572c8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:08.458837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:08.459618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.459905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.460182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] PATH_INFO: `/v3/users/d51809c85b7141c49fafe7823480e54e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.461293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] RBAC: Authorizing `identity:get_user(user_id=d51809c85b7141c49fafe7823480e54e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:08.487543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:08.488971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 522/1044] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:08 2022] GET /identity/v3/users/d51809c85b7141c49fafe7823480e54e => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:08.494271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:08.504143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edd38-d1d6-4507-841c-0ee48862ece9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:08.508200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:08.508758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.509045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.509326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.516806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:08.542085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:08.550858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 523/1045] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:08 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:08.556443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:08.565496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188886-a680-4d98-9f18-16190b17fc00 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:08.569551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:08.570314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.570596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.570905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.571975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:08.598379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d522eb-1fed-45e5-abb4-2b2ce97f6b07 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:08.599888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 523/1046] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:08 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:08.605464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:08.613626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd7198-0ed6-4283-8570-73577ed42d31 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:08.617692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:08.618251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:08.618589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:08.618904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:08.619670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] RBAC: Adding query filter params (role.id=bc097fad0c624faf8db8ee926f98f9e0, scope.project.id=ff0558a11bf94e0e99800216ec872b33, user.id=d51809c85b7141c49fafe7823480e54e) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:08.619972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:08.646477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f53e4-0f5a-473d-aad1-a20a7a65c9db admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:08.656011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 524/1047] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:08 2022] GET /identity/v3/role_assignments?user.id=d51809c85b7141c49fafe7823480e54e&scope.project.id=ff0558a11bf94e0e99800216ec872b33&role.id=bc097fad0c624faf8db8ee926f98f9e0 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:10.622643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd06e6-c429-407f-9af7-128028b4b528 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:10.623289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd06e6-c429-407f-9af7-128028b4b528 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:10.623289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd06e6-c429-407f-9af7-128028b4b528 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:10.624878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 524/1048] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:10.630542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:10.630984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:10.631147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:10.654034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:10.655205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:10.662875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 525/1049] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:10 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:10.685200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd06e6-c429-407f-9af7-128028b4b528 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:10.696655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd06e6-c429-407f-9af7-128028b4b528 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:10.700586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:10.701286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:10.701572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:10.701845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:10.702935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:10.728924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1378fc-de5a-47be-beed-78445ec4d001 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:10.730350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 525/1050] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:10.735901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:10.744431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c30375-fc46-4aa5-b71e-a11e8cacae26 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:10.748510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:10.749085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:10.749375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:10.749656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:10.750300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:10.776935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befba91-90bc-4bd3-a6c2-ba491b106e7b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:10.803451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 526/1051] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:32:10 2022] POST /identity/v3/projects => generated 311 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:32:12.771300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637367d-1a28-4679-b617-8dcd22656fe6 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:12.771831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637367d-1a28-4679-b617-8dcd22656fe6 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:12.771925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637367d-1a28-4679-b617-8dcd22656fe6 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:12.773516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 526/1052] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:12.778603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:12.779053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:12.779207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:12.801709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:12.802869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:12.867219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 527/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:12.890166 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637367d-1a28-4679-b617-8dcd22656fe6 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:12.902459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637367d-1a28-4679-b617-8dcd22656fe6 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:12.906339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:12.907712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:12.908029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:12.908309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:12.909399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:12.934473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d625c-d63f-49ca-9683-68d3326324c1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:12.935923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 527/1054] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:12.941642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:12.950167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824802f5-f787-4d22-a2f5-d553b130cf40 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:12.954996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:12.955587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:12.955878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:12.956160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:12.956808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:12.983169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b67c94-609c-48b5-ae5d-615b3eafe232 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:13.002244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 528/1055] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:32:12 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:32:15.036095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07250e-dcb8-4bf1-8f3e-98e8027f42bc None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.036614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07250e-dcb8-4bf1-8f3e-98e8027f42bc None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.036735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07250e-dcb8-4bf1-8f3e-98e8027f42bc None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.039213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 528/1056] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:15.044261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.044706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.044825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.068350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:15.069525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:15.076325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 529/1057] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:32:15.103942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07250e-dcb8-4bf1-8f3e-98e8027f42bc None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.116006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07250e-dcb8-4bf1-8f3e-98e8027f42bc None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.119906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.120619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.120903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.121176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.133437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:15.139667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:15.140776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 529/1058] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:32:15.147810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.157673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cc043-70c7-44ba-9993-0f71617bdbe6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.161962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.162561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.162887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.163172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.163890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:15.164187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:15.193374 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:15.202416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 530/1059] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:15.209366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.219025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3e254-8652-4a31-b4b7-871c1fc45d43 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.223825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.224612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.224901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.225183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] PATH_INFO: `/v3/users/443cef1fae604529b51cb1ae854df262` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.243847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] RBAC: Authorizing `identity:get_user(user_id=443cef1fae604529b51cb1ae854df262)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:15.270700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:15.272323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 530/1060] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/users/443cef1fae604529b51cb1ae854df262 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:15.278344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.288477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170372-48d0-4202-afbb-8e46d926fb2f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.293156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.293734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.294039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.294319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.302584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:15.333802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:15.343127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 531/1061] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:15.349763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.358996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1a8ee-5698-4bcd-b69d-02ffa8751622 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.363353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.364127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.364414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.364690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] PATH_INFO: `/v3/projects/5278c0c01f574ca7a9de0c530680d77c` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.365755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] RBAC: Authorizing `identity:get_project(project_id=5278c0c01f574ca7a9de0c530680d77c)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:15.391589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5940-7bb7-4b35-856c-aea468e04f42 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:15.393076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 531/1062] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/projects/5278c0c01f574ca7a9de0c530680d77c => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:15.398923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:15.407834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40639b-4e42-443a-a238-81513348a032 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:15.412179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:15.412768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:15.413124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:15.413409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:15.414229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=5278c0c01f574ca7a9de0c530680d77c, user.id=443cef1fae604529b51cb1ae854df262) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:15.414537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:15.440486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ab85-f0bb-4dce-9741-18f2c1efdfc7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:15.446094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 532/1063] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:15 2022] GET /identity/v3/role_assignments?user.id=443cef1fae604529b51cb1ae854df262&scope.project.id=5278c0c01f574ca7a9de0c530680d77c&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:17.385267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2ce2-b9bc-4b32-a8dc-9c8a563688c4 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.385854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2ce2-b9bc-4b32-a8dc-9c8a563688c4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.385854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2ce2-b9bc-4b32-a8dc-9c8a563688c4 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.387553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 532/1064] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:17.392539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.392918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.393113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.415147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:17.416269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:17.423524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 533/1065] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:17.445227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b2ce2-b9bc-4b32-a8dc-9c8a563688c4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:17.456694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b2ce2-b9bc-4b32-a8dc-9c8a563688c4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:17.460662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:17.461367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.461659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.461946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.472834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:17.479214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:17.480274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 533/1066] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:17.486304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:17.494734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49fd1d-a38e-486c-964f-1c1cc109bf09 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:17.498761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:17.499343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.499633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.499914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.501504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:17.501806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:17.527129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:17.536259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 534/1067] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:17.541837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:17.552387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa4c9-d10b-43af-80f8-1cd99ed278dd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:17.556503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:17.557274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.557567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.557853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] PATH_INFO: `/v3/users/443cef1fae604529b51cb1ae854df262` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.558985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] RBAC: Authorizing `identity:get_user(user_id=443cef1fae604529b51cb1ae854df262)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:17.584952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:17.586384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 534/1068] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:17 2022] GET /identity/v3/users/443cef1fae604529b51cb1ae854df262 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:17.591530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:17.601187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895ead-0c8a-46a8-b884-ec964dd8f28c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:17.605188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:17.605948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.606233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.606510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] PATH_INFO: `/v3/projects/5278c0c01f574ca7a9de0c530680d77c` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.607598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] RBAC: Authorizing `identity:get_project(project_id=5278c0c01f574ca7a9de0c530680d77c)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:17.632826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c77d7-0183-4a73-bf7d-8f88fa57af89 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:17.634291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 535/1069] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:17 2022] GET /identity/v3/projects/5278c0c01f574ca7a9de0c530680d77c => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:17.639792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:17.649954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728035e-0223-4167-ae60-b3e0c6b06ef6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:17.654190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:17.655022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:17.655313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:17.655593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] PATH_INFO: `/v3/projects/5278c0c01f574ca7a9de0c530680d77c/users/443cef1fae604529b51cb1ae854df262/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:17.658479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5278c0c01f574ca7a9de0c530680d77c, user_id=443cef1fae604529b51cb1ae854df262, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:17.684907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf77ef6-0c12-4f34-95e8-27fd95a56d4c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:17.698113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 535/1070] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:32:17 2022] PUT /identity/v3/projects/5278c0c01f574ca7a9de0c530680d77c/users/443cef1fae604529b51cb1ae854df262/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:32:19.707650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc8ade-d488-43de-a3b0-4ea01f954b44 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.708207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc8ade-d488-43de-a3b0-4ea01f954b44 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.708207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc8ade-d488-43de-a3b0-4ea01f954b44 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.709860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 536/1071] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:19.715044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.715506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.715622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.739032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:19.740171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:19.804699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 536/1072] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:19 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:19.827130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc8ade-d488-43de-a3b0-4ea01f954b44 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:19.839107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc8ade-d488-43de-a3b0-4ea01f954b44 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:19.843038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:19.843739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.844640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.844875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.856441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:19.862585 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:19.863654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 537/1073] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:19.869394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:19.878420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5061ed-95ad-4a00-8593-7e1a68ca2864 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:19.882548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:19.883160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.883456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.883741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.884455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:19.884759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:19.911633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:19.919999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 537/1074] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:19.925423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:19.934431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954c297-2fe9-4c1f-bb9a-affc7ec0c31d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:19.938965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:19.939734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.940020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.940298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] PATH_INFO: `/v3/users/443cef1fae604529b51cb1ae854df262` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.941376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] RBAC: Authorizing `identity:get_user(user_id=443cef1fae604529b51cb1ae854df262)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:19.967304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:19.968712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 538/1075] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:19 2022] GET /identity/v3/users/443cef1fae604529b51cb1ae854df262 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:19.974581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:19.983726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffcce1-31ed-4e28-a18b-668029a43ff2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:19.987874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:19.988441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:19.988730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:19.989009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:19.996482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:20.022977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:20.031231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 538/1076] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:19 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:20.036968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:20.046092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127f55-00da-4b9b-9f45-3bade145e59d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:20.050163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:20.050961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:20.051254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:20.051537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] PATH_INFO: `/v3/projects/5278c0c01f574ca7a9de0c530680d77c` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:20.052609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5278c0c01f574ca7a9de0c530680d77c)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:20.079043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb19bd-701d-46a8-8691-2d5ae07995f5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:20.080593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 539/1077] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:20 2022] GET /identity/v3/projects/5278c0c01f574ca7a9de0c530680d77c => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:20.086155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:20.094555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d49f6-2ce8-413f-8a68-f5417a6ffdec admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:20.098683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:20.099261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:20.099554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:20.099837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:20.100613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=5278c0c01f574ca7a9de0c530680d77c, user.id=443cef1fae604529b51cb1ae854df262) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:20.100920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:20.126855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2bfa9-aa6c-4ac2-8637-f2c15782bb00 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:20.132435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 539/1078] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:20 2022] GET /identity/v3/role_assignments?user.id=443cef1fae604529b51cb1ae854df262&scope.project.id=5278c0c01f574ca7a9de0c530680d77c&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:32:22.079783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f4f-404b-4260-9ef4-baaea151ea33 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:22.080313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f4f-404b-4260-9ef4-baaea151ea33 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:22.080313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f4f-404b-4260-9ef4-baaea151ea33 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:22.081983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 540/1079] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:22.087327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:22.087744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:22.087898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:22.110309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:22.111456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:22.118114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 540/1080] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:22 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:22.138925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c1f4f-404b-4260-9ef4-baaea151ea33 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:22.151084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c1f4f-404b-4260-9ef4-baaea151ea33 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:22.154994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:22.155556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:22.155842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:22.156122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:22.164089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:22.189666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:22.197902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 541/1081] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:22 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:22.204215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:22.212677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125e6d8-b075-4cc4-8d87-91655471a813 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:22.216745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344755-5704-41fa-a792-38fea680625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:22.217461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344755-5704-41fa-a792-38fea680625a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:22.217751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344755-5704-41fa-a792-38fea680625a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:22.218029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344755-5704-41fa-a792-38fea680625a admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:22.225808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88344755-5704-41fa-a792-38fea680625a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:22.251621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88344755-5704-41fa-a792-38fea680625a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:22.266491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-88344755-5704-41fa-a792-38fea680625a admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 08 02:32:22.267550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 541/1082] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:32:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:32:22.273285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:22.281658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f423e0-de65-45fb-bf25-740f8e58db96 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:22.285906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:22.286471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:22.286793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:22.287073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:22.287747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:22.288040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:22.313344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121424-06b7-4f3a-b3ed-18a6fbad16f4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:22.320939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 542/1083] 10.222.0.48 () {56 vars in 1136 bytes} [Fri Apr 8 02:32:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:24.245398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a62d-feba-4589-bf89-8c336bcd78b3 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:24.245892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a62d-feba-4589-bf89-8c336bcd78b3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:24.245892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a62d-feba-4589-bf89-8c336bcd78b3 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:24.247572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 542/1084] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:24.253774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e7d9-c4d1-4d98-a15c-97233ece0cc5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:24.254170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e7d9-c4d1-4d98-a15c-97233ece0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:24.254349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0e7d9-c4d1-4d98-a15c-97233ece0cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:24.277178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b8c0e7d9-c4d1-4d98-a15c-97233ece0cc5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:24.278311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b8c0e7d9-c4d1-4d98-a15c-97233ece0cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:24.285768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 543/1085] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:24 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:24.308152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6a62d-feba-4589-bf89-8c336bcd78b3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:24.320102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6a62d-feba-4589-bf89-8c336bcd78b3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:24.324013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:24.324581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:24.324866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:24.325144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:24.325836 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:24.350636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:32:24.350636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:32:24.350636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:32:24.351623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba0380-9889-4448-aec5-b34969de4c93 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:24.366147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 543/1086] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Apr 8 02:32:24 2022] POST /identity/v3/domains => generated 267 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:32:26.343625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63cbc9-9305-46d4-9c96-d121a1f63eed None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:26.344308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63cbc9-9305-46d4-9c96-d121a1f63eed None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:26.344308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63cbc9-9305-46d4-9c96-d121a1f63eed None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:26.345894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 544/1087] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:26.351137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:26.351552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:26.351705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:26.374393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:26.376209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:26.440973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 544/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:26 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:32:26.463333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63cbc9-9305-46d4-9c96-d121a1f63eed None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:26.474840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63cbc9-9305-46d4-9c96-d121a1f63eed None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:26.478841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:26.479611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:26.479902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:26.480184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] PATH_INFO: `/v3/domains/dc23ebcc20d3491fa7f23b9c06f6eeac` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:26.492351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dc23ebcc20d3491fa7f23b9c06f6eeac)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:26.518392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d7f2e-dded-4e52-a5cf-3231cd876892 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:26.519862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 545/1089] 10.222.0.48 () {56 vars in 1204 bytes} [Fri Apr 8 02:32:26 2022] GET /identity/v3/domains/dc23ebcc20d3491fa7f23b9c06f6eeac => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:26.525685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:26.534021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268d80-f5db-4485-8368-fd8dd6349fa4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:26.538021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:26.538594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:26.538921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:26.539200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:26.539843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:26.566396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9635a3-af2b-4492-81a3-d14a3a7f8334 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:26.592069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 545/1090] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:32:26 2022] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:32:28.576038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f88bd-8f1d-4684-904a-73b3d093a618 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:28.576588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f88bd-8f1d-4684-904a-73b3d093a618 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:28.576588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f88bd-8f1d-4684-904a-73b3d093a618 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:28.578329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 546/1091] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:28.583623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:28.584027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:28.584189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:28.605420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:28.606535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:28.668434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 546/1092] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:28.692377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f88bd-8f1d-4684-904a-73b3d093a618 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:28.703859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f88bd-8f1d-4684-904a-73b3d093a618 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:28.707813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:28.708592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:28.708882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:28.709163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] PATH_INFO: `/v3/domains/dc23ebcc20d3491fa7f23b9c06f6eeac` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:28.710225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dc23ebcc20d3491fa7f23b9c06f6eeac)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:28.737057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586af20-3ad8-4431-95bf-4096a58092f2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:28.738531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 547/1093] 10.222.0.48 () {56 vars in 1204 bytes} [Fri Apr 8 02:32:28 2022] GET /identity/v3/domains/dc23ebcc20d3491fa7f23b9c06f6eeac => generated 267 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:28.744061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:28.753421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45000ad-7d72-443d-881f-78fbd4f63231 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:28.757430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:28.758017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:28.758306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:28.758587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:28.759262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:28.784834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4411e7a-c5a9-48c8-acd7-f00c25b993ed admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:28.805220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 547/1094] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:32:28 2022] POST /identity/v3/users => generated 311 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:32:30.808445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ec64-0e97-43f0-9111-195143538596 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:30.808993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ec64-0e97-43f0-9111-195143538596 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:30.808993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ec64-0e97-43f0-9111-195143538596 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:30.810679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 548/1095] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:30.815695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:30.816062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:30.816265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:30.838473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:30.839636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:30.846446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 548/1096] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:30.868436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ec64-0e97-43f0-9111-195143538596 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:30.880453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ec64-0e97-43f0-9111-195143538596 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:30.884336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:30.885033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:30.885319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:30.885598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:30.896805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:30.903045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:30.904084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 549/1097] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:30.909736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:30.918052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351f70-ccd9-484f-b704-e19bd0552769 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:30.922656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:30.923255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:30.923544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:30.923826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:30.924524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:30.924913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:30.950370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:30.959090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 549/1098] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:30.964658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:30.974940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed01dc-aab5-4546-900d-efc21fa623ef admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:30.978971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:30.979749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:30.980034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:30.980310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] PATH_INFO: `/v3/users/3b9f21576c5d4669a5393a2eb5824c90` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:30.998747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b9f21576c5d4669a5393a2eb5824c90)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:31.025087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:31.026577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 550/1099] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:30 2022] GET /identity/v3/users/3b9f21576c5d4669a5393a2eb5824c90 => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:31.032546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:31.041631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc81d95-a13b-41c9-83f9-97d3e8846123 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:31.045643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:31.046207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:31.046500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:31.047421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:31.054853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:31.080752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:31.088981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 550/1100] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:31 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:32:31.094757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:31.103944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dd2cc-dfea-4983-91a4-d4b728472cd3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:31.108029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:31.108824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:31.109609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:31.110112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] PATH_INFO: `/v3/projects/2eb35e952da64270ba7999460f44e133` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:31.111242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eb35e952da64270ba7999460f44e133)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:31.137186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75155d46-bb54-41bf-9fa8-bb7e2c632e87 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:31.138703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 551/1101] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:31 2022] GET /identity/v3/projects/2eb35e952da64270ba7999460f44e133 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:31.144302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:31.152865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c414cc4-9468-42a9-b43e-b93616e3f133 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:31.157582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:31.158148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:31.158434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:31.158744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:31.159518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=2eb35e952da64270ba7999460f44e133, user.id=3b9f21576c5d4669a5393a2eb5824c90) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:31.159822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:31.185619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2d6d-e96b-44b0-86a0-6d1fa0dce4a5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:31.190954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 551/1102] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:31 2022] GET /identity/v3/role_assignments?user.id=3b9f21576c5d4669a5393a2eb5824c90&scope.project.id=2eb35e952da64270ba7999460f44e133&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:33.126154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f549f-281a-434c-b9a3-f3789c5525d5 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.126699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f549f-281a-434c-b9a3-f3789c5525d5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.126822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f549f-281a-434c-b9a3-f3789c5525d5 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.128435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 552/1103] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:33.133919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.134324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.134479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.156593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:33.157715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:33.164372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 552/1104] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:33 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:32:33.186228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f549f-281a-434c-b9a3-f3789c5525d5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:33.198395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f549f-281a-434c-b9a3-f3789c5525d5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:33.202366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:33.203117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.203412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.203695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.214503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:33.221509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:33.222567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 553/1105] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:33.228206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:33.237323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922f869-53c5-48f4-98ee-0c9a199faeb3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:33.241270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:33.241849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.242134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.242413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.243149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:33.243447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:33.269185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:33.277722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 553/1106] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:33.283319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:33.293275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60049b7-1e76-4af7-8419-5f1ab586e980 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:33.298171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:33.298983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.299275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.299555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] PATH_INFO: `/v3/users/3b9f21576c5d4669a5393a2eb5824c90` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.300645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b9f21576c5d4669a5393a2eb5824c90)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:33.326113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:33.327595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 554/1107] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:33 2022] GET /identity/v3/users/3b9f21576c5d4669a5393a2eb5824c90 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:33.333451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:33.342328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c52f-f79d-411d-ac36-7308bc48e80a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:33.346724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:33.347492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.347782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.348062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] PATH_INFO: `/v3/projects/2eb35e952da64270ba7999460f44e133` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.349128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] RBAC: Authorizing `identity:get_project(project_id=2eb35e952da64270ba7999460f44e133)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:33.375826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a9c34-f9b1-48be-bb3a-a0af753bbe6b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:33.377302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 554/1108] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:33 2022] GET /identity/v3/projects/2eb35e952da64270ba7999460f44e133 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:33.382515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:33.391588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1e82-fe9b-4c93-b2d8-40ee23d27dc9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:33.395885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:33.396665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:33.396954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:33.397234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] PATH_INFO: `/v3/projects/2eb35e952da64270ba7999460f44e133/users/3b9f21576c5d4669a5393a2eb5824c90/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:33.399001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb35e952da64270ba7999460f44e133, user_id=3b9f21576c5d4669a5393a2eb5824c90, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:33.425952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019eeaba-ffb8-41f7-9bbc-cadfd1b6d3cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:33.438138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 555/1109] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:32:33 2022] PUT /identity/v3/projects/2eb35e952da64270ba7999460f44e133/users/3b9f21576c5d4669a5393a2eb5824c90/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:32:35.362854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1046-07b9-40a3-8488-828cb30b2d6c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.363369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1046-07b9-40a3-8488-828cb30b2d6c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.363466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1046-07b9-40a3-8488-828cb30b2d6c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.365071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 555/1110] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:35.370138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.370508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.370748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.393292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:35.394430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:35.458918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 556/1111] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:35 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:35.481123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1046-07b9-40a3-8488-828cb30b2d6c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.493182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1046-07b9-40a3-8488-828cb30b2d6c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.497111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.497820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.498107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.498385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.510561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:32:35.516801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:32:35.517861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 556/1112] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:35.523782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.532152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c6072-b044-4ea8-8c85-649f22e1f36a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.536192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.536776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.537065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.537345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.538057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:35.538355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:35.564811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:35.573135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 557/1113] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:35.578805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.587864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3b9ef-a6b9-438a-8d48-4c3cf044153a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.592026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.592806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.593097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.593437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] PATH_INFO: `/v3/users/3b9f21576c5d4669a5393a2eb5824c90` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.594845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] RBAC: Authorizing `identity:get_user(user_id=3b9f21576c5d4669a5393a2eb5824c90)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:35.620967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:35.622345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 557/1114] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/users/3b9f21576c5d4669a5393a2eb5824c90 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:32:35.628255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.637159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96495-d8a3-46d6-8b03-042ee413554a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.641268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.641823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.642111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.642390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.650049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:35.676507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:35.684760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 558/1115] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:35.690390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.699298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e47ac-95bc-466d-a373-972c1b22572b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.703414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.704167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.704456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.704735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] PATH_INFO: `/v3/projects/2eb35e952da64270ba7999460f44e133` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.705797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] RBAC: Authorizing `identity:get_project(project_id=2eb35e952da64270ba7999460f44e133)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:35.731485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0ee5b-0af0-4fa6-b893-0362904f5ddb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:35.732958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 558/1116] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/projects/2eb35e952da64270ba7999460f44e133 => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:35.739183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:35.747483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ad62c-e078-42fd-a480-dbbfa0e0731b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:35.751701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:35.752274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:35.752544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:35.752820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:35.753580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=2eb35e952da64270ba7999460f44e133, user.id=3b9f21576c5d4669a5393a2eb5824c90) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:32:35.753880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:32:35.778939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0807e5c-88b5-42c3-952e-18791bd665d1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:35.784986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 559/1117] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:35 2022] GET /identity/v3/role_assignments?user.id=3b9f21576c5d4669a5393a2eb5824c90&scope.project.id=2eb35e952da64270ba7999460f44e133&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:02.802298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262b11b-1f03-4c28-b2a5-4935aca4f938 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:02.802918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262b11b-1f03-4c28-b2a5-4935aca4f938 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:02.802918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262b11b-1f03-4c28-b2a5-4935aca4f938 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:02.804564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 559/1118] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:02.810645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:02.811066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:02.811232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:02.833143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:02.834277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:02.841011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 560/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:02 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:02.864901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262b11b-1f03-4c28-b2a5-4935aca4f938 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:02.876522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262b11b-1f03-4c28-b2a5-4935aca4f938 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:02.880488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e14676-147c-4926-b833-806764d928cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:02.881211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14676-147c-4926-b833-806764d928cc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:02.881486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14676-147c-4926-b833-806764d928cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:02.881764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14676-147c-4926-b833-806764d928cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:02.893607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e14676-147c-4926-b833-806764d928cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:02.919497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e14676-147c-4926-b833-806764d928cc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:02.937735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-28e14676-147c-4926-b833-806764d928cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:02.942728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 560/1120] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:02.945201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:02.955062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5bc0c-f534-438c-97ef-d5831225cf9e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:02.959631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:02.960212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:02.960501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:02.960777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:02.961462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:02.961759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:02.987537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38160d7e-a36a-4b85-a189-2325e01f9eb2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:03.001707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 561/1121] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:03.007569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e14676-147c-4926-b833-806764d928cc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:03.018393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e14676-147c-4926-b833-806764d928cc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:03.022755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:03.023650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:03.023650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:03.023650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:03.027050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:03.051384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c581e17-e5fe-4dcc-90aa-798fc6c52769 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:03.070697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 561/1122] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Apr 8 02:34:03 2022] POST /identity/v3/users => generated 251 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:34:05.067517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14ac-108a-417d-9956-603fdeff36ea None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.068029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14ac-108a-417d-9956-603fdeff36ea None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.068139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e14ac-108a-417d-9956-603fdeff36ea None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.069722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 562/1123] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:05.074685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.075067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.075275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.097430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:05.098559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:05.105322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 562/1124] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:05 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:05.127882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e14ac-108a-417d-9956-603fdeff36ea None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.139258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e14ac-108a-417d-9956-603fdeff36ea None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.143165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.143870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.144410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.144688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.155444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:05.162360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:34:05.163421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 563/1125] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:05.168944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.177943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52eccf-2273-4fbb-afa6-7370953bb8bd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.182063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.182646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.182969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.183255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.183963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.184266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.210047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.218193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 563/1126] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:05.224216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.233644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c5ab-92fd-4ab5-845c-789ca905d08c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.237699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.238380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.238690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.238979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.249823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.275936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.294073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:05.295997 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 564/1127] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:05.301537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.310633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d73f2-d2eb-45e2-bfcc-8d52c4ba0217 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.314946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.315522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.315810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.316091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.316773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.317070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.342754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.355729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 564/1128] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:05.361267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.370390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f6a7-542f-434d-8441-f4ac939f9679 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.374460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.375205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.375497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.375807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.388219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.414787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.433367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:05.434525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 565/1129] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:05.440508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.449829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e25c-8a56-477c-8bd2-6769a71c8567 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.454794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.455468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.455757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.456030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.456825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.457128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.483288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.514450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 565/1130] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:05.520640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.530026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82be5b-c2c8-44de-9ea6-197e2cdbe5ba admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.535146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253632-f33e-4294-981a-e052591a346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.535734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253632-f33e-4294-981a-e052591a346a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.536020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253632-f33e-4294-981a-e052591a346a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.536297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36253632-f33e-4294-981a-e052591a346a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.544144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36253632-f33e-4294-981a-e052591a346a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.570243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36253632-f33e-4294-981a-e052591a346a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.580329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 566/1131] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:05.586207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.596128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73853a-d41c-4bbd-9d2a-46879e348993 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.600567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.601283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.601570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.601846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.615270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.641296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.659462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:05.660572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 566/1132] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:05.666338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253632-f33e-4294-981a-e052591a346a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.675704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36253632-f33e-4294-981a-e052591a346a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.679885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.680470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.680759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.681040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.681752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.682049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.707031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.719363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 567/1133] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:05.725133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.734202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827e61-2d5f-4aaa-9ffb-2ac3ebf9046b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.738957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.739654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.739946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.740226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.748974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.774494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.788382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:05.789419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 567/1134] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:05.795033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.804225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6bd8-8fde-4a39-804f-fc107b30fb44 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.808356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.808933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.809225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.809506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.810245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.810545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.836914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8c51-8539-4ee2-9b20-de7c6ef21418 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.849667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 568/1135] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:05.855349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:05.864347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf031-ac52-4916-a2f2-0e02036a2076 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:05.868374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:05.868937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:05.869227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:05.869505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:05.870279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=4068eaf366e54d0e88043780889a0893) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:05.870584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:05.897092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9face-f217-4e38-9933-9b8573e38707 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:05.902758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 568/1136] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:34:05 2022] GET /identity/v3/role_assignments?user.id=4068eaf366e54d0e88043780889a0893&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:07.868152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94624-2e1f-4427-b370-0d61c0e10961 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:07.868705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94624-2e1f-4427-b370-0d61c0e10961 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:07.868705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d94624-2e1f-4427-b370-0d61c0e10961 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:07.870372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 569/1137] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:07.876235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:07.876668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:07.876902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:07.899805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:07.900942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:07.907789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 569/1138] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:07.929210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94624-2e1f-4427-b370-0d61c0e10961 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:07.942469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d94624-2e1f-4427-b370-0d61c0e10961 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:07.947235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:07.948120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:07.948441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:07.948824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:07.962895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:07.969902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:34:07.971250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 570/1139] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:34:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:07.977672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:07.987689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91813c71-0b35-445a-b973-fdab7d121223 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:07.992620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:07.993227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:07.993517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:07.993796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:07.994520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:07.994862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.022168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.031243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 570/1140] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:34:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:08.037521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.047735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d40c9-b11a-4257-af29-741755037dc2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.051800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.052507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.052795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.053076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.064555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.090336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.107460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:08.108509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 571/1141] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:08.114227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.123413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cbda1-2440-4188-88f3-3f64f51075ec admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.128416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.128999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.129291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.129573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.130255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:08.130555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.156747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.169466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 571/1142] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:08.175078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.184194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7de7-97b2-4f64-8cb5-9d39599cd2f1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.189093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.189582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.189870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.190148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.202422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.227904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.253933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:08.255565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 572/1143] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:08.261136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.270695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76db947-08b2-4539-a217-e6a4fa9182f0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.274775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.275369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.275659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.275939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.276732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:08.277038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.303204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.332137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 572/1144] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:08.337705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.346962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6194a-f196-43d0-b830-3492b803106c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.350997 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.351699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.351992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.352272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.365691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.391151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.407830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:08.408854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 573/1145] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:08.414439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.424057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4cac-6dcd-4c82-b0c7-d5c58da9ed22 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.428134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6970d-9671-486d-9189-459646665307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.428717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6970d-9671-486d-9189-459646665307 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.429009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6970d-9671-486d-9189-459646665307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.429293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6970d-9671-486d-9189-459646665307 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.429975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6970d-9671-486d-9189-459646665307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:08.430276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6970d-9671-486d-9189-459646665307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.456293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6970d-9671-486d-9189-459646665307 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.468651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 573/1146] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:08.473942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.482885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044952-9eca-490b-bda6-a0d554710b64 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.487433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.488124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.488409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.488685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.497285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.523468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.536711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:08.537757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 574/1147] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:08.543396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6970d-9671-486d-9189-459646665307 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.552911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6970d-9671-486d-9189-459646665307 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.557032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.557608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.557897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.558178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.558951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:08.559255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.586128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d3f9d-87d0-4a8f-b416-7197285232aa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.600195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 574/1148] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:08.606144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:08.615935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a5dad-e6f9-4986-9c38-f03f9db4aa90 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:08.619943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:08.620742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:08.621025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:08.621299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/4068eaf366e54d0e88043780889a0893/roles/7499afdcb5604641aa2d0bbffc2ff098` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:08.640641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=4068eaf366e54d0e88043780889a0893, role_id=7499afdcb5604641aa2d0bbffc2ff098)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:08.667419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4506825-5763-4143-9ce1-281c2716c982 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:08.680612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 575/1149] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:34:08 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/4068eaf366e54d0e88043780889a0893/roles/7499afdcb5604641aa2d0bbffc2ff098 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:34:10.692809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25616dd-3b5e-4883-8aae-2bd571001c76 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:10.693367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25616dd-3b5e-4883-8aae-2bd571001c76 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:10.693367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25616dd-3b5e-4883-8aae-2bd571001c76 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:10.695086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 575/1150] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:10.700212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:10.700621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:10.700780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:10.723621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:10.724748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:10.787263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 576/1151] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:10.809160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25616dd-3b5e-4883-8aae-2bd571001c76 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:10.820634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25616dd-3b5e-4883-8aae-2bd571001c76 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:10.824524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:10.825230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:10.825516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:10.825795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:10.837092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:10.843443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:34:10.845123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 576/1152] 10.222.0.48 () {56 vars in 1123 bytes} [Fri Apr 8 02:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:10.850637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:10.859000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc32da4-dfcd-4b6b-8038-4b3188b019e9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:10.863430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:10.864012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:10.864297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:10.864574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:10.865280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:10.865576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:10.891132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:10.900196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 577/1153] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Apr 8 02:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:10.905694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:10.915218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931d72-a2e7-4153-a9a2-edaae1dd1af3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:10.919224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:10.919917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:10.920204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:10.920484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:10.931295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:10.958220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:10.978625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:10.980323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 577/1154] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:10.987095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:10.997760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c737174-d18a-4326-afe1-041fa8f07913 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.002601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.003217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.003508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.003790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.004477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:11.004774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.030791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.043377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 578/1155] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:11.049097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.058300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077aa4a-ca27-4094-b435-4c3ca63f41fb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.062356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.063640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.064106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.064396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.079732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.105264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.122784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:11.123837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 578/1156] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:11.130153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.139391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25add-a9c0-4aee-bc0a-e40f798327ee admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.144304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.144894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.145179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.145455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.146235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:11.146533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.171851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.200073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 579/1157] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:11.207280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.221070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019d68-04f0-4de9-82e6-a31d3de183fe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.226798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.227647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.228085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.228509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.239932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.276988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.289129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 579/1158] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:11.294871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.304572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5686e-4737-4a21-91ba-ff584302fda8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.308607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.309312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.309598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.309877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.321772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.347641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.364761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:11.365804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 580/1159] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:34:11.371244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.380242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c030f73-03db-421e-bae3-1ebcede22616 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.384354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.384936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.385225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.385508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.386186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:11.386485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.411902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.424757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 580/1160] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:11.430061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.439926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9544c-9a31-42a4-8846-f4118fcc2417 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.443911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.444605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.444891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.445167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.453965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.479032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.492684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:11.493691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 581/1161] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:11.499302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.509034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e1b06-4c83-4259-a54f-fdbcbb2fccbd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.513162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.513741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.514035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.514320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.515096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:11.515403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.541024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af5e31-135a-4885-bfa6-79dfbc124c5c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.554173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 581/1162] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:11.559878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:11.569786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d5926-bb6a-4bb0-9989-810548861904 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:11.573855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:11.574448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:11.574770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:11.575052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:11.575837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] RBAC: Adding query filter params (role.id=7499afdcb5604641aa2d0bbffc2ff098, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=4068eaf366e54d0e88043780889a0893) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:11.576137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:11.602399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257174a-d5aa-4c2a-b521-fa6eafa7f779 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:11.608620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 582/1163] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:34:11 2022] GET /identity/v3/role_assignments?user.id=4068eaf366e54d0e88043780889a0893&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=7499afdcb5604641aa2d0bbffc2ff098 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:13.677947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea8e7-9e42-4b09-b258-32d7a8583684 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.678510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea8e7-9e42-4b09-b258-32d7a8583684 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.678510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea8e7-9e42-4b09-b258-32d7a8583684 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.680221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 582/1164] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:13.685351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.685787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.685913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.708542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:13.709657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:13.716335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 583/1165] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:13 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:13.739190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ea8e7-9e42-4b09-b258-32d7a8583684 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:13.750880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ea8e7-9e42-4b09-b258-32d7a8583684 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:13.755013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:13.755721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.756011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.756292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.768066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:13.774651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:34:13.775730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 583/1166] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:13.781114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:13.790097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36138050-5743-4cec-9b2b-0c6eb50a2bb1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:13.794133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:13.794736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.795023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.795301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.796004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:13.796296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:13.821193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:13.830309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 584/1167] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:13.835759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:13.845908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b452d7e-da60-472d-8d46-ca809b174e5f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:13.849926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:13.850619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.850944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.851224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.862328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:13.887937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:13.905716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:13.906834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 584/1168] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:13.912197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:13.921311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d1ed2-086d-4303-8f25-6e138d4a0c13 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:13.925448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:13.926022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.926310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.926591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:13.927299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:13.927596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:13.953314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:13.968670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 585/1169] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:13.974370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:13.986344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac6e98-91a7-476f-93b7-13284e6fb332 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:13.991854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:13.992631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:13.992922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:13.993201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.006963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.033403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.051018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:14.052084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 585/1170] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:14.057845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.067560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e650-5763-45d5-b25a-de8232f4fb05 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.071589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.072176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.072459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.072736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.073522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:14.073819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.099850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.128081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 586/1171] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:14.133619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.143290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046b816-ab64-4b8e-83a3-65d632627076 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.147581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.148150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.148440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.148724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.156204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.181788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.191467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 586/1172] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:14.196930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.206032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d295e9-bc41-41b9-af37-9456aa0e904a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.210025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.210759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.211049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.211327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.222427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.247965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.265313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:14.266430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 587/1173] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:14.272335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.280769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccf50e-265f-44af-ba7f-d5bef56b53d8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.285035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.285618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.285908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.286191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.286905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:14.287208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.312767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.325678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 587/1174] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:14.331071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.340058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4076b-f86e-470e-877b-374f8a403ac8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.344318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.345020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.345311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.345593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.354531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.380816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.394714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:14.395768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 588/1175] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:14.401450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.410656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c95e8-f78d-4b5e-94cc-391b476c5e19 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.414696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.415275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.415564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.415844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.416579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:14.416888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.443630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4f1f-e77b-4e0f-91dc-fc82238255ea admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.456322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 588/1176] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:14.461750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:14.470852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ad8d5-803a-4770-9f04-b6d0c2de646f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:14.474945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:14.475517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:14.475805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:14.476085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:14.476860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=4068eaf366e54d0e88043780889a0893) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:14.477166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:14.503730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad96f-496c-42f9-b5fe-55facbab2301 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:14.509333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 589/1177] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:34:14 2022] GET /identity/v3/role_assignments?user.id=4068eaf366e54d0e88043780889a0893&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:16.526832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d8f-3c8e-483a-9dcb-0eb8d1418695 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.527360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d8f-3c8e-483a-9dcb-0eb8d1418695 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.527449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d8f-3c8e-483a-9dcb-0eb8d1418695 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.529050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 589/1178] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:16.534347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.534777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.534940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.557509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:16.558635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:16.566073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 590/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:16 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:16.587599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7d8f-3c8e-483a-9dcb-0eb8d1418695 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.599123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7d8f-3c8e-483a-9dcb-0eb8d1418695 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.603062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.603767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.604054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.604334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.615611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:16.621799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:34:16.622873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 590/1180] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:16.629306 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.637682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aac5f-8a20-46a2-9d96-122a81f2b39e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.642029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.642608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.642932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.643216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.643924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:16.644476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:16.669407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:16.678211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 591/1181] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:16.683572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.693597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f7c5e-4cea-4a5b-a3d6-fa74521c4c9d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.697612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.698297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.698588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.698908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.709692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:16.735708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:16.754265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:16.755449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 591/1182] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:16.761275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.773094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848386-f905-419d-9fe8-718b0323a3c3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.779060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.779883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.780324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.780753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.781831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:16.782301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:16.819402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:16.832259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 592/1183] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:16.837912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.847703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebd9d-fb46-4c3e-af7f-1d049deeea9f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.851832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.852554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.852846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.853131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.867547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:16.892911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:16.911042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:16.912085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 592/1184] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:16.919512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:16.929496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255106-6c78-428f-9d20-4b6f8ddc3c1f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:16.933645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:16.934237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:16.934528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:16.934845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:16.935633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:16.935935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:16.961361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:16.990566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 593/1185] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:16.996237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:17.005758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe77d6-e801-4641-b35e-5d40a7b0f5ac admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:17.009766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:17.010606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:17.010925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:17.011204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:17.023413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:17.050024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:17.066298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:17.067382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 593/1186] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:17.073106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:17.083176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd5062-8e3c-40d0-9838-b1de11d908fa admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:17.088877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:17.089895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:17.090427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:17.090999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:17.092003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:17.092413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:17.119338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:17.132788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 594/1187] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:17.138426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:17.147942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b944a-04fa-4753-adc7-25d316e14618 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:17.151931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:17.152639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:17.152925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:17.153202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:17.162415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:17.188255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:17.201373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:17.202408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 594/1188] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:17.208451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:17.217505 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22e482-75ae-47a6-83bc-ccbe269e23ce admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:17.222146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:17.222745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:17.223037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:17.223316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:17.224056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:17.224355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:17.249666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b419-4b42-4df4-81c7-139ae3f3ad12 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:17.262210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 595/1189] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:17.268420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:17.277612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defe061-f123-49d5-800d-e7411adc1df3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:17.281621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:17.282845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:17.283134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:17.283415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] PATH_INFO: `/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/4068eaf366e54d0e88043780889a0893/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:17.285129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f47efdd4248db9900ec38a64d16f0, user_id=4068eaf366e54d0e88043780889a0893, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:17.311842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d37fb-9a09-4cf5-ae8a-497f00241609 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:17.324726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 595/1190] 10.222.0.48 () {58 vars in 1460 bytes} [Fri Apr 8 02:34:17 2022] PUT /identity/v3/projects/e59f47efdd4248db9900ec38a64d16f0/users/4068eaf366e54d0e88043780889a0893/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:34:19.274834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862cfa-7332-4dbe-874d-4abf0943a6fb None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.275434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862cfa-7332-4dbe-874d-4abf0943a6fb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.275434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862cfa-7332-4dbe-874d-4abf0943a6fb None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.276987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 596/1191] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:19.282450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.282911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.283201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.305880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:19.307026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:19.368698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 596/1192] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:19.390185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79862cfa-7332-4dbe-874d-4abf0943a6fb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.402184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79862cfa-7332-4dbe-874d-4abf0943a6fb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.406268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.407522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.407813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.408092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.419054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Apr 08 02:34:19.425979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:34:19.427066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 597/1193] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:19.432671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.441067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808f64-2c6f-41dd-85f6-fe4f691162ac None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.445115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.445698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.445985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.446263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.447008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:19.447308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.473470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.481729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 597/1194] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:19.487152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.496648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72a28-6edf-46e5-9d38-409e713dd776 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.500824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.501523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.501814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.502098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.513033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.539879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.558200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:19.559267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 598/1195] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:19.564834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.573785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd00505-d9bc-4d56-b10e-4402d2ca27bd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.577806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.578377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.579200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.579487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.580162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:19.580463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.605472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.618433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 598/1196] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:19.623737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.633364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504b3d6-cd97-4317-b720-fc674bff5ac1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.637573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.638287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.638585 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.638891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.652673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.679737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.697629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:34:19.698680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 599/1197] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:19.704676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.713602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8fcd5-cc38-43ce-9620-7912f23806e5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.717630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.718208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.718497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.718816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.720161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:19.720462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.745708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.774417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 599/1198] 10.222.0.48 () {56 vars in 1164 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:19.779782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.789740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fb943-386f-414b-8436-1e719d15e67c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.793813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.794322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.794609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.794912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.802443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.827479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.836988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 600/1199] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:34:19.842468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.852146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cfef-6bf8-483a-af81-97eb9c853104 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.856197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.856896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.857183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.857460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.872392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.899326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.915709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:34:19.916753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 600/1200] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:34:19.922199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.930691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d2da-f64b-410d-bc48-250d9bb36459 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.935044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.935748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.936051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.936351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:19.937067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:19.937366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:19.963313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:19.975918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 601/1201] 10.222.0.48 () {56 vars in 1130 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:19.981386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:19.990486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a3e8-f2c5-41eb-9817-b6f3adf8df2a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:19.994504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:19.995241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:19.995527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:19.995806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:20.005047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:20.031074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:20.044777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING keystone.server.flask.application [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:34:20.045795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 601/1202] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Apr 8 02:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:34:20.051727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:20.060882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa00a1-aed6-4a77-8b6f-25cd7f6764a6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:20.065715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:20.066306 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:20.066584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:20.066899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:20.067637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:20.067936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:20.094197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514722e8-2057-4663-b0ef-1fe98acf7e45 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:20.106775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 602/1203] 10.222.0.48 () {56 vars in 1169 bytes} [Fri Apr 8 02:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:20.112557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:20.121639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107341c-6ff2-4bbd-851a-86ce902da10d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:20.126251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:20.126845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:20.127134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:20.127415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:20.128187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] RBAC: Adding query filter params (role.id=25829623b314474f90be394caa52cb01, scope.project.id=e59f47efdd4248db9900ec38a64d16f0, user.id=4068eaf366e54d0e88043780889a0893) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:20.128491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:20.154578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78d5f-9823-4c74-902e-b881ad13f331 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:20.160454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 602/1204] 10.222.0.48 () {56 vars in 1395 bytes} [Fri Apr 8 02:34:20 2022] GET /identity/v3/role_assignments?user.id=4068eaf366e54d0e88043780889a0893&scope.project.id=e59f47efdd4248db9900ec38a64d16f0&role.id=25829623b314474f90be394caa52cb01 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:22.138496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273221-9f67-4597-8704-b9a1b4c7febd None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:22.139062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273221-9f67-4597-8704-b9a1b4c7febd None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:22.139158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273221-9f67-4597-8704-b9a1b4c7febd None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:22.140747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 603/1205] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:22.146199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:22.146597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:22.146800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:22.169321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:22.170450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:22.177727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 603/1206] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:22.199011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273221-9f67-4597-8704-b9a1b4c7febd None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:22.211226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273221-9f67-4597-8704-b9a1b4c7febd None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:22.215155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:22.215868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:22.216161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:22.216445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:22.217069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:22.244016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:22.254698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:34:22.255734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 604/1207] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:34:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:22.261275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:22.269882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be651b1e-af1c-4b31-9042-f1bd372a5fbb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:22.273882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:22.274457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:22.274783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:22.275064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:22.275728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:22.276025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:22.301687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631946-1ea7-4a3d-82a2-ce99e33a4d94 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:22.306359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 604/1208] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Apr 8 02:34:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:22.311693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:22.321682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c143027-a945-47a7-b534-48652f25ab19 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:22.325952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:22.326524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:22.326861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:22.327140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] PATH_INFO: `/v3/services` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:22.327800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:22.328094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:22.353430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2b0fb-c049-4aa3-b464-73de450a71cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:22.357704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 605/1209] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Apr 8 02:34:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:24.313485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b755-a668-4470-af17-e8ded3eb9ea6 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:24.313988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b755-a668-4470-af17-e8ded3eb9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:24.313988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b755-a668-4470-af17-e8ded3eb9ea6 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:24.315688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 605/1210] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:24.320731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019980-5ead-4fcb-9c7a-e5e19633b968 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:24.321157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019980-5ead-4fcb-9c7a-e5e19633b968 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:24.321297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019980-5ead-4fcb-9c7a-e5e19633b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:24.343686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d4019980-5ead-4fcb-9c7a-e5e19633b968 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:24.345463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d4019980-5ead-4fcb-9c7a-e5e19633b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:24.352151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 606/1211] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:24 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:24.373704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7b755-a668-4470-af17-e8ded3eb9ea6 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:24.385754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7b755-a668-4470-af17-e8ded3eb9ea6 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:24.389727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:24.390305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:24.390596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:24.390909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:24.392159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:24.417767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9b1bb-63a9-4926-b7f7-bcd7e063fecd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:24.430312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 606/1212] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Apr 8 02:34:24 2022] POST /identity/v3/services => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:34:26.404710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b24e-71d8-4c95-adaf-3169f576b453 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.405251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b24e-71d8-4c95-adaf-3169f576b453 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.405251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42b24e-71d8-4c95-adaf-3169f576b453 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.407720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 607/1213] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:26.412826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.413205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.413402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.436715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:26.437850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:26.455290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 607/1214] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:26.477542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b24e-71d8-4c95-adaf-3169f576b453 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:26.489396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42b24e-71d8-4c95-adaf-3169f576b453 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:26.493311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:26.494016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.494305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.494579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.495222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:26.520988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:26.531122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:34:26.532752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 608/1215] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:34:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:34:26.538360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:26.546792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904a11-a651-4515-b02f-1b8ef6897216 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:26.551105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:26.551687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.551977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.552256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.552925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:26.553225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:26.578305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:26.584161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 608/1216] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Apr 8 02:34:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:26.589653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:26.598650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe779ed-ce03-46e4-a444-d089837fd275 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:26.602708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:26.603270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.603559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.603837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.604571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] RBAC: Adding query filter params (interface=public, service_id=efb99f1b536c4554b28c9d78d126b6ee, region_id=RegionOne) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:26.604871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:26.630543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e99a-2a60-42a4-83b8-46c12265eb17 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:26.635749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 609/1217] 10.222.0.48 () {56 vars in 1272 bytes} [Fri Apr 8 02:34:26 2022] GET /identity/v3/endpoints?service_id=efb99f1b536c4554b28c9d78d126b6ee&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:26.641755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:26.651215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e70b-4418-4ef6-8140-b870325d8ccd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:26.655407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:26.655940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:26.656234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:26.656525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:26.657175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:26.682140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e16752-624e-4f0b-8670-564fed4f87b3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:26.689708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 609/1218] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:34:26 2022] GET /identity/v3/services => generated 2430 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:34:28.641556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665281c-294c-40c4-b3d1-37256d3f0a52 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:28.642283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665281c-294c-40c4-b3d1-37256d3f0a52 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:28.642283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665281c-294c-40c4-b3d1-37256d3f0a52 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:28.643804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 610/1219] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:28.649041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:28.649418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:28.649604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:28.671641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:28.673434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:28.680148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 610/1220] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:28.702705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665281c-294c-40c4-b3d1-37256d3f0a52 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:28.714172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665281c-294c-40c4-b3d1-37256d3f0a52 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:28.718078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:28.718813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:28.719143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:28.719425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:28.720039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:28.745500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:28.756502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING keystone.server.flask.application [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:34:28.757564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 611/1221] 10.222.0.48 () {56 vars in 1138 bytes} [Fri Apr 8 02:34:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:34:28.763272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:28.772148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85890f-e3a2-4315-b8b9-65d2d914f60d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:28.776209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:28.776814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:28.777100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:28.777377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] PATH_INFO: `/v3/services` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:28.778093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:34:28.778390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:28.803929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d411009-32dc-4863-a4da-1a4da69784dd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:28.808974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 611/1222] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Apr 8 02:34:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:34:28.815056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:28.825062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206b88-8f44-4c51-9a42-2532474c9fbd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:28.829263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:28.829829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:28.830119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:28.830405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:28.831130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:34:28.856486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bf87a-ba47-4dce-b049-bfc392bc652d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:28.873819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 612/1223] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Apr 8 02:34:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:36:07.918263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:07.918837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:07.918837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:07.920489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 612/1224] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:07.925836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ddc0-933b-45a1-ad82-48a5babd588e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:07.926278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ddc0-933b-45a1-ad82-48a5babd588e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:07.926416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ddc0-933b-45a1-ad82-48a5babd588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:08.014073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a781ddc0-933b-45a1-ad82-48a5babd588e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:08.015277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a781ddc0-933b-45a1-ad82-48a5babd588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:08.121764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 613/1225] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:08.143959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:08.145901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:08.286276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ea88-db07-4ae1-b777-0e8972728681 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:08.396251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:08.396842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:08.397129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:08.397408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:08.398104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:08.423819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470dfa-f314-485b-abce-c79aed3aca11 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:08.438357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 613/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:36:08 2022] GET /identity/v3/projects => generated 2553 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:36:10.452298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9163ee-aab6-40fd-b83f-f5e4de3d5980 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:10.452851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9163ee-aab6-40fd-b83f-f5e4de3d5980 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:10.452851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9163ee-aab6-40fd-b83f-f5e4de3d5980 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:10.454533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 614/1227] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:10.459837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4916d-07f2-437f-b6f7-14c0d39a6f5d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:10.460237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4916d-07f2-437f-b6f7-14c0d39a6f5d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:10.460425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4916d-07f2-437f-b6f7-14c0d39a6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:10.548532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-20c4916d-07f2-437f-b6f7-14c0d39a6f5d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:10.549686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-20c4916d-07f2-437f-b6f7-14c0d39a6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:10.655103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 614/1228] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:36:10.701965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:10.702259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:10.702546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:10.704258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 615/1229] 10.222.0.48 () {54 vars in 963 bytes} [Fri Apr 8 02:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:10.709853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3beb2d-a5b6-4ac0-b618-b97ead32a093 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:10.710153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3beb2d-a5b6-4ac0-b618-b97ead32a093 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:10.710442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3beb2d-a5b6-4ac0-b618-b97ead32a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:10.805576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1d3beb2d-a5b6-4ac0-b618-b97ead32a093 None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:10.807351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1d3beb2d-a5b6-4ac0-b618-b97ead32a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:10.892495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 615/1230] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Apr 8 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:10.902207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:10.903671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:11.021942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aabdc-da8c-4ea0-8692-e5c6ccd7ce4c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:11.105270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:11.105848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:11.106136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:11.106413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:11.107975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:11.229558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:11.255007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfdc6-ecc1-4725-b275-c5e83ea54cf9 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:11.274316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 616/1231] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:13.503263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:13.503794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:13.503883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:13.505528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 616/1232] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:13.510922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa639-2e9e-47eb-b1a6-f6d5a5edc6fc None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:13.511345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa639-2e9e-47eb-b1a6-f6d5a5edc6fc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:13.511489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa639-2e9e-47eb-b1a6-f6d5a5edc6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:13.595819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f75fa639-2e9e-47eb-b1a6-f6d5a5edc6fc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:13.596968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f75fa639-2e9e-47eb-b1a6-f6d5a5edc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:13.702143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 617/1233] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:13.738780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:13.740261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:13.861027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a8ea-7bde-41d8-aa78-fa9eb2c1bd03 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:13.943291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:13.943875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:13.944226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:13.944522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:13.946062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:14.076423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:14.102157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0ca99-43fb-4e80-be1f-5f8aef928128 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:14.124502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 617/1234] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:16.390193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:16.390744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:16.390863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:16.392493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 618/1235] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:16.397788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:16.398183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:16.398353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:16.482973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:16.484145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:16.586714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 618/1236] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:16.621037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:16.622480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:16.762063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f270d-ddd7-461c-bfd8-472915d6c3f8 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:16.865390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:16.866456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:16.866775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:16.867062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:16.877768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:16.904075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352007c7-a848-4a0f-baa3-134801d772db admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:16.905625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 619/1237] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:16 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:16.918416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:16.919574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:17.023725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adff37-5c45-45a0-9eaf-b12a2beba77a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:17.111489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:17.112068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:17.112357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:17.112635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:17.114160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:17.234625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:17.259991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad5459-04e9-4e1b-878e-da0cda86f344 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:17.280076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 619/1238] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:19.830022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:19.830477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:19.830581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:19.832294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 620/1239] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:19.837303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:19.838200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:19.838521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:19.925402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:19.926549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:20.032070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 620/1240] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:20.063149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:20.064576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:20.201883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae7fd2-647c-4cc9-951c-98a63b76a6d7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:20.303910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:20.304678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:20.304962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:20.305237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:20.316832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:20.342630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc40c6-0ca6-46dd-ae0c-073776584478 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:20.344206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 621/1241] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:20 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:20.356698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:20.357838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:20.459523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019767f-19f6-4f59-8e46-7fb0fd63ac9d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:20.549741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:20.550327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:20.550618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:20.550930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:20.552473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:20.674477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:20.700758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efaa8f-50ea-4aaf-bf01-02e460e90dcb service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:20.720033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 621/1242] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:23.358122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:23.358747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:23.358747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:23.360545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 622/1243] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:23.365729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc873a-7c02-4eee-8948-4295201a4150 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:23.366185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc873a-7c02-4eee-8948-4295201a4150 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:23.366439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc873a-7c02-4eee-8948-4295201a4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:23.456116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-25bc873a-7c02-4eee-8948-4295201a4150 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:23.457303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-25bc873a-7c02-4eee-8948-4295201a4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:23.571462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 622/1244] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:23.607728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:23.609243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:23.731370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e381-3c7f-4799-829c-e895a0b1164f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:23.813179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:23.813755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:23.814043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:23.814320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:23.815866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:23.941869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:23.969190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89959-ccfe-4d52-bcdb-ed2a89f57cef service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:23.991673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 623/1245] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:26.029260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f70f3-c5de-4d74-a5c5-dd05e9829f59 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:26.029798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f70f3-c5de-4d74-a5c5-dd05e9829f59 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:26.029891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f70f3-c5de-4d74-a5c5-dd05e9829f59 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:26.031545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 623/1246] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:26.037025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd62b-25dd-49e7-9b06-b6ef09b65d83 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:26.037449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd62b-25dd-49e7-9b06-b6ef09b65d83 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:26.037600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd62b-25dd-49e7-9b06-b6ef09b65d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:26.128932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ba8fd62b-25dd-49e7-9b06-b6ef09b65d83 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:26.130275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ba8fd62b-25dd-49e7-9b06-b6ef09b65d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:26.238556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 624/1247] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:26.287761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:26.288054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:26.288341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:26.290040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 624/1248] 10.222.0.48 () {54 vars in 963 bytes} [Fri Apr 8 02:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:26.296554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3eb5b-12f8-4121-b71c-741bd4c91d08 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:26.296857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3eb5b-12f8-4121-b71c-741bd4c91d08 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:26.297144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3eb5b-12f8-4121-b71c-741bd4c91d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:26.396597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-56e3eb5b-12f8-4121-b71c-741bd4c91d08 None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:26.398048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-56e3eb5b-12f8-4121-b71c-741bd4c91d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:26.484912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 625/1249] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Apr 8 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:26.494901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:26.496367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:26.626878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30357774-e168-443d-aa71-9d5328bb2a07 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:26.711414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:26.711999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:26.712795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:26.713241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:26.714873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:26.839590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:26.864433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8bb6-1430-4de1-b335-ceb193d61645 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:26.884863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 625/1250] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:29.120099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.120639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.120769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.122357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 626/1251] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:29.127577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.127984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.128154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.296463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:29.297523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:29.401512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 626/1252] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:29.432056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:29.433493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:29.571259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4006ff-cc80-4a00-9246-2bd1d1b3ab78 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:29.673468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:29.674243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.674528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.674836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.685998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:29.712272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa563d5-f0b1-4f3b-92bb-a21689cd84f0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:29.714026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 627/1253] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:29 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:29.725869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:29.727042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:29.830927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e17fed-3b9b-48a8-b72a-ac2c7d4a3032 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:29.913938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:29.914521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.914841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.915123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.916789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:30.039562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:30.064274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2c422-b93c-48c9-813d-4ddcd3819431 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:30.084340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 627/1254] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:32.281705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:32.282266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:32.282266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:32.283954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 628/1255] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:32.289009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381380-e1e0-4eaf-86ac-c70bd7ee4e64 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:32.289432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381380-e1e0-4eaf-86ac-c70bd7ee4e64 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:32.289580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381380-e1e0-4eaf-86ac-c70bd7ee4e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:32.374171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-76381380-e1e0-4eaf-86ac-c70bd7ee4e64 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:32.375348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-76381380-e1e0-4eaf-86ac-c70bd7ee4e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:32.480728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 628/1256] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:32.515237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:32.516680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:32.634161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c9432-b226-4af7-a853-eb9c322e771c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:32.716152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:32.716735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:32.717028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:32.717309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:32.718864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:32.840405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:32.865698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc1a36-16be-4e56-a094-ba78343377bc service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:32.885711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 629/1257] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:34.924522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:34.925089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:34.925089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:34.926875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 629/1258] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:34.932540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221317-b126-4a63-8146-d809cb2e4da2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:34.932951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221317-b126-4a63-8146-d809cb2e4da2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:34.933105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93221317-b126-4a63-8146-d809cb2e4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:35.019462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-93221317-b126-4a63-8146-d809cb2e4da2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:35.020881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-93221317-b126-4a63-8146-d809cb2e4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:35.126237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 630/1259] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:35.166530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:35.168055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:35.284007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982d4d-d75c-46ea-8a4e-4039c4848ae9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:35.365936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:35.366515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:35.366839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:35.367124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:35.368671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:35.489040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:35.514295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa04dac-6957-4296-b678-5f089d68520a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:35.535601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 630/1260] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:37.924132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:37.924627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:37.924627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:37.926301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 631/1261] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:37.931654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ab5-3104-46b3-af02-979f43e487b2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:37.932061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ab5-3104-46b3-af02-979f43e487b2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:37.932207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95ab5-3104-46b3-af02-979f43e487b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:38.019634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0fd95ab5-3104-46b3-af02-979f43e487b2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:38.021037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0fd95ab5-3104-46b3-af02-979f43e487b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:38.126650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 631/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:38.161492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:38.164817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:38.373785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133ee6-b6a6-4e9e-8d41-3dca56974f38 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:38.377147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:38.377727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:38.378027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:38.378311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:38.379974 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:38.495389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:38.520682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496519-e45e-4174-85c3-a9ad55fd2958 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:38.541544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 632/1263] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:42.812675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db03-ff2a-4ba6-b795-803f277c87ae None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:42.813234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db03-ff2a-4ba6-b795-803f277c87ae None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:42.813234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95db03-ff2a-4ba6-b795-803f277c87ae None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:42.814968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 632/1264] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:42.820159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2be9-82f4-4acc-a179-e7bda610f3a5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:42.820574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2be9-82f4-4acc-a179-e7bda610f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:42.820744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2be9-82f4-4acc-a179-e7bda610f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:42.880163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4ddb2be9-82f4-4acc-a179-e7bda610f3a5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:42.881299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4ddb2be9-82f4-4acc-a179-e7bda610f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:42.888425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 633/1265] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:42.927677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db03-ff2a-4ba6-b795-803f277c87ae None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:42.939221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95db03-ff2a-4ba6-b795-803f277c87ae None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:42.942446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:42.943063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:42.943358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:42.943650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:42.954084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:42.981808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0531727-16b5-41ac-86a6-2135470fb76c service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:42.991630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 633/1266] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:36:45.818234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33deec-26c6-4354-8e67-17b5507d1baf None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:45.818830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33deec-26c6-4354-8e67-17b5507d1baf None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:45.818830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33deec-26c6-4354-8e67-17b5507d1baf None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:45.820512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 634/1267] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:45.826311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b625-ea57-41f9-aa3d-66be7cbae322 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:45.826722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b625-ea57-41f9-aa3d-66be7cbae322 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:45.826991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b625-ea57-41f9-aa3d-66be7cbae322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:45.849776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-cd34b625-ea57-41f9-aa3d-66be7cbae322 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:45.850975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cd34b625-ea57-41f9-aa3d-66be7cbae322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:45.859099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 634/1268] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:36:45.898772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33deec-26c6-4354-8e67-17b5507d1baf None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:45.909693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33deec-26c6-4354-8e67-17b5507d1baf None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:45.912959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:45.913536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:45.913827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:45.914112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:45.923547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:45.950053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106563e-641a-4077-b9da-42f8ff66d516 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:45.961729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 635/1269] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:50.219386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1300-746b-49ce-bef9-e4fb134055dc None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:50.219778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1300-746b-49ce-bef9-e4fb134055dc None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:50.219924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1300-746b-49ce-bef9-e4fb134055dc None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:50.221872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 635/1270] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:50.227644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70698e-14d3-4c8d-b574-99621b883014 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:50.228426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70698e-14d3-4c8d-b574-99621b883014 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:50.228426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70698e-14d3-4c8d-b574-99621b883014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:50.251895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5a70698e-14d3-4c8d-b574-99621b883014 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:50.253059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5a70698e-14d3-4c8d-b574-99621b883014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:50.261901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 636/1271] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:50.300243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1300-746b-49ce-bef9-e4fb134055dc None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:50.310979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1300-746b-49ce-bef9-e4fb134055dc None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:50.314221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:50.314831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:50.315123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:50.315408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:50.325553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:36:50.351394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea3770-59ed-4156-bf7c-f1ce3db9356e service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:50.361840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 636/1272] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:54.796039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a03d-6ccb-4f5b-ba45-5a4ea01626b1 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:54.796944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a03d-6ccb-4f5b-ba45-5a4ea01626b1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:54.797406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a03d-6ccb-4f5b-ba45-5a4ea01626b1 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:54.799417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 637/1273] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:54.804126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804542b-fc7e-480e-9e74-2c8f4e7e8986 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:54.806046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804542b-fc7e-480e-9e74-2c8f4e7e8986 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:54.806574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804542b-fc7e-480e-9e74-2c8f4e7e8986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:54.913274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1804542b-fc7e-480e-9e74-2c8f4e7e8986 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:54.914702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1804542b-fc7e-480e-9e74-2c8f4e7e8986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:55.016130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 637/1274] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:55.398745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611354-68bf-46e1-8dba-99ee148f8985 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:55.406753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611354-68bf-46e1-8dba-99ee148f8985 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:55.410383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611354-68bf-46e1-8dba-99ee148f8985 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:55.412797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 638/1275] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:36:55 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:55.419005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdaa2-399c-4a43-bfcd-8833b234a129 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:55.419407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdaa2-399c-4a43-bfcd-8833b234a129 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:55.419788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccdaa2-399c-4a43-bfcd-8833b234a129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:55.461620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-15ccdaa2-399c-4a43-bfcd-8833b234a129 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:55.463049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-15ccdaa2-399c-4a43-bfcd-8833b234a129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:55.479988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 638/1276] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:59.452675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172925-26ce-47db-875b-10cf652725f6 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:59.453200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172925-26ce-47db-875b-10cf652725f6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:59.453279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172925-26ce-47db-875b-10cf652725f6 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:59.455264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 639/1277] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:59.464263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4569fe-7932-4157-be73-09aa7e248f81 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:59.464719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4569fe-7932-4157-be73-09aa7e248f81 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:59.464821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4569fe-7932-4157-be73-09aa7e248f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:59.487461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8f4569fe-7932-4157-be73-09aa7e248f81 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:59.488642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8f4569fe-7932-4157-be73-09aa7e248f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:59.496423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 639/1278] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:00.894586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356561-da8d-4bb0-92c2-33c42ef39f03 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.895384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356561-da8d-4bb0-92c2-33c42ef39f03 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.895493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356561-da8d-4bb0-92c2-33c42ef39f03 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.897076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 640/1279] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:00.902503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03e5a-2c8c-49e7-919d-8a4009b6f096 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.902941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03e5a-2c8c-49e7-919d-8a4009b6f096 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.903135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03e5a-2c8c-49e7-919d-8a4009b6f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.926418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-69f03e5a-2c8c-49e7-919d-8a4009b6f096 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:00.927616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-69f03e5a-2c8c-49e7-919d-8a4009b6f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:00.935636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 640/1280] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:04.318049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283ec-7af9-46c0-b8fa-70c49a8fca8d None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:04.318562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283ec-7af9-46c0-b8fa-70c49a8fca8d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:04.318654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283ec-7af9-46c0-b8fa-70c49a8fca8d None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:04.320311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 641/1281] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:37:04.326357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1b63-f690-42a1-bb7f-764fdacbc239 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:04.326799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1b63-f690-42a1-bb7f-764fdacbc239 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:04.327009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1b63-f690-42a1-bb7f-764fdacbc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:04.349742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b3be1b63-f690-42a1-bb7f-764fdacbc239 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:04.350914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b3be1b63-f690-42a1-bb7f-764fdacbc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:04.357977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 641/1282] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:04.448720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800af51-f303-4226-a65e-e55552e7a86a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:04.449034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800af51-f303-4226-a65e-e55552e7a86a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:04.449319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800af51-f303-4226-a65e-e55552e7a86a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:04.451033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 642/1283] 10.222.0.48 () {54 vars in 954 bytes} [Fri Apr 8 02:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:04.456274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfb69-09b6-4cfd-83e0-8a960871a7f9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:04.456569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfb69-09b6-4cfd-83e0-8a960871a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:04.456858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfb69-09b6-4cfd-83e0-8a960871a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:04.525312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7a4cfb69-09b6-4cfd-83e0-8a960871a7f9 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:04.526737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7a4cfb69-09b6-4cfd-83e0-8a960871a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:04.613566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 642/1284] 10.222.0.48 () {58 vars in 1051 bytes} [Fri Apr 8 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:04.622150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800af51-f303-4226-a65e-e55552e7a86a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:04.635858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800af51-f303-4226-a65e-e55552e7a86a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:04.640662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:04.641258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:04.641545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:04.641824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:04.649996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:04.675210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef156c-eedb-40c3-88e1-22ac457bc53a service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:04.684654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 643/1285] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:06.825599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805c92-6069-4632-8675-e50c2a873bc9 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:06.826103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805c92-6069-4632-8675-e50c2a873bc9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:06.826103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805c92-6069-4632-8675-e50c2a873bc9 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:06.827795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 643/1286] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:06.832946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f83c7-e98d-4778-b7f1-6c416b30b3a4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:06.833345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f83c7-e98d-4778-b7f1-6c416b30b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:06.833514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f83c7-e98d-4778-b7f1-6c416b30b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:06.857334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5c8f83c7-e98d-4778-b7f1-6c416b30b3a4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:06.858481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5c8f83c7-e98d-4778-b7f1-6c416b30b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:06.865428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 644/1287] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:06.957455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618958-3cc0-4b16-a759-1f84bee247e8 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:06.957749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618958-3cc0-4b16-a759-1f84bee247e8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:06.958065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618958-3cc0-4b16-a759-1f84bee247e8 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:06.959900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 644/1288] 10.222.0.48 () {54 vars in 954 bytes} [Fri Apr 8 02:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:06.965164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c0d-d3c1-4516-84b3-bea5caca32d4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:06.965555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c0d-d3c1-4516-84b3-bea5caca32d4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:06.965908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3c0d-d3c1-4516-84b3-bea5caca32d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:06.988248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ac9f3c0d-d3c1-4516-84b3-bea5caca32d4 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:06.989415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ac9f3c0d-d3c1-4516-84b3-bea5caca32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:06.998196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 645/1289] 10.222.0.48 () {58 vars in 1051 bytes} [Fri Apr 8 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:07.006181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618958-3cc0-4b16-a759-1f84bee247e8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:07.020416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618958-3cc0-4b16-a759-1f84bee247e8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:07.025453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:07.026023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:07.026315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:07.026596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:07.034434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:07.060428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856a56-4be5-4bd1-bc16-dcc018bc310d service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:07.069274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 645/1290] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:37:09.403255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a382b-3685-41fe-8eaf-bf2a8ae36cc8 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:09.403822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a382b-3685-41fe-8eaf-bf2a8ae36cc8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:09.403822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a382b-3685-41fe-8eaf-bf2a8ae36cc8 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:09.405472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 646/1291] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:09.410522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60c47-12ee-4ba8-9859-95d349c7b9dd None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:09.410927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60c47-12ee-4ba8-9859-95d349c7b9dd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:09.411127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c60c47-12ee-4ba8-9859-95d349c7b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:09.433909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-93c60c47-12ee-4ba8-9859-95d349c7b9dd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:09.435100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-93c60c47-12ee-4ba8-9859-95d349c7b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:09.441987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 646/1292] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:09.528697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a382b-3685-41fe-8eaf-bf2a8ae36cc8 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:09.542338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a382b-3685-41fe-8eaf-bf2a8ae36cc8 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:09.547178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:09.547744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:09.548036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:09.548317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:09.556710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:09.581511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8801f-9a57-4373-930d-348ffa05746d service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:09.590327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 647/1293] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:11.864233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efae95-a222-49cd-94a8-24e0825bb73c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:11.864657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efae95-a222-49cd-94a8-24e0825bb73c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:11.864810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efae95-a222-49cd-94a8-24e0825bb73c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:11.866509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 647/1294] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:11.872684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f746e-a2df-44ac-9e60-1acb5e3004b9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:11.873126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f746e-a2df-44ac-9e60-1acb5e3004b9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:11.873265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f746e-a2df-44ac-9e60-1acb5e3004b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:11.896883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ea7f746e-a2df-44ac-9e60-1acb5e3004b9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:11.898015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ea7f746e-a2df-44ac-9e60-1acb5e3004b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:11.905121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 648/1295] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:11.991009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efae95-a222-49cd-94a8-24e0825bb73c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:12.005025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efae95-a222-49cd-94a8-24e0825bb73c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:12.009944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:12.010523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:12.010852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:12.011135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:12.019008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:12.045023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79c9a1-436d-4b7e-925c-55374cf8756a service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:12.054081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 648/1296] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:14.261074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e071-0985-46cc-94c5-40d8145bab17 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.261617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e071-0985-46cc-94c5-40d8145bab17 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.261617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e071-0985-46cc-94c5-40d8145bab17 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.263295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 649/1297] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:14.268509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0574-543f-4a54-8ab2-de3415f25eef None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.268951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0574-543f-4a54-8ab2-de3415f25eef None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.269062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a0574-543f-4a54-8ab2-de3415f25eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.291884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2a4a0574-543f-4a54-8ab2-de3415f25eef None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:14.292994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2a4a0574-543f-4a54-8ab2-de3415f25eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:14.299768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 649/1298] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:14.389777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e071-0985-46cc-94c5-40d8145bab17 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:14.403272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e071-0985-46cc-94c5-40d8145bab17 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:14.408098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:14.408660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.408942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.409218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.416866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:14.441925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eab659-cd0c-45b5-a2d5-23b1fc2afd4e service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:14.451399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 650/1299] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:16.561384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451545f5-d0af-45f3-adad-e654853f65d4 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:16.561922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451545f5-d0af-45f3-adad-e654853f65d4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:16.562051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451545f5-d0af-45f3-adad-e654853f65d4 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:16.563716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 650/1300] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:16.568879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549216-ca62-43e0-8b04-d66528656363 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:16.569288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549216-ca62-43e0-8b04-d66528656363 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:16.569446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a549216-ca62-43e0-8b04-d66528656363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:16.592750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7a549216-ca62-43e0-8b04-d66528656363 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:16.593890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7a549216-ca62-43e0-8b04-d66528656363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:16.600726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 651/1301] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:16.689826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451545f5-d0af-45f3-adad-e654853f65d4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:16.706785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451545f5-d0af-45f3-adad-e654853f65d4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:16.713259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:16.713879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:16.714139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:16.714424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:16.725270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:16.756540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2336-f044-4dbb-a65a-6c96e12441c5 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:16.769283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 651/1302] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:18.890049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7cc87-afcf-4cb9-8a8d-55a66f4f0b7a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:18.890615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7cc87-afcf-4cb9-8a8d-55a66f4f0b7a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:18.890615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7cc87-afcf-4cb9-8a8d-55a66f4f0b7a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:18.892293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 652/1303] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:18.897894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116c46-3647-4361-b8e0-f4aea6a6a945 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:18.898284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116c46-3647-4361-b8e0-f4aea6a6a945 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:18.898496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d116c46-3647-4361-b8e0-f4aea6a6a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:18.920818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6d116c46-3647-4361-b8e0-f4aea6a6a945 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:18.921953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6d116c46-3647-4361-b8e0-f4aea6a6a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:18.928806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 652/1304] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:19.014950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7cc87-afcf-4cb9-8a8d-55a66f4f0b7a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:19.028604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7cc87-afcf-4cb9-8a8d-55a66f4f0b7a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:19.033447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:19.034015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:19.034304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:19.034585 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:19.042627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:19.067795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26839dc2-f3f3-4663-a21d-cc20af25c4be service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:19.077943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 653/1305] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:21.102549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ab98-2ea9-4d82-97dc-87aa539652ac None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:21.103153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ab98-2ea9-4d82-97dc-87aa539652ac None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:21.103153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ab98-2ea9-4d82-97dc-87aa539652ac None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:21.104892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 653/1306] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:21.110150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b29e-5e71-44f0-ab9c-079725fe97db None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:21.110555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b29e-5e71-44f0-ab9c-079725fe97db None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:21.110750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b29e-5e71-44f0-ab9c-079725fe97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:21.133086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2895b29e-5e71-44f0-ab9c-079725fe97db None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:21.134215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2895b29e-5e71-44f0-ab9c-079725fe97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:21.141037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 654/1307] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:21.227699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ab98-2ea9-4d82-97dc-87aa539652ac None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:21.240718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ab98-2ea9-4d82-97dc-87aa539652ac None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:21.245601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:21.246168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:21.246456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:21.246763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:21.254394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:21.280779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c2c9-696f-4c32-aed1-81fd11fa5897 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:21.290270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 654/1308] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:23.350555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe935-a11b-4a1e-a110-aa1371940e96 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.350555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe935-a11b-4a1e-a110-aa1371940e96 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.350555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe935-a11b-4a1e-a110-aa1371940e96 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.353684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 655/1309] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:37:23.361668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2e67-c952-4481-8f5b-40ef50c5ad5f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.362527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2e67-c952-4481-8f5b-40ef50c5ad5f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.362527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2e67-c952-4481-8f5b-40ef50c5ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.385920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-52ca2e67-c952-4481-8f5b-40ef50c5ad5f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:23.387110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-52ca2e67-c952-4481-8f5b-40ef50c5ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:23.394068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 655/1310] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:23.479975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe935-a11b-4a1e-a110-aa1371940e96 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:23.493910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe935-a11b-4a1e-a110-aa1371940e96 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:23.498820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:23.499404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.499685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.499965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.507769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:23.533567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc4faf-93f6-4e7e-b2fb-8f632f054176 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:23.543244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 656/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:25.684008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442789-6f90-44c1-87de-f5a2c3ff5471 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:25.684573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442789-6f90-44c1-87de-f5a2c3ff5471 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:25.684573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442789-6f90-44c1-87de-f5a2c3ff5471 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:25.686266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 656/1312] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:25.691531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd243f-6f7f-4e20-b945-2018526995ea None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:25.691977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd243f-6f7f-4e20-b945-2018526995ea None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:25.692083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd243f-6f7f-4e20-b945-2018526995ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:25.714652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3ebd243f-6f7f-4e20-b945-2018526995ea None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:25.715810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3ebd243f-6f7f-4e20-b945-2018526995ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:25.722684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 657/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:25.816333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93442789-6f90-44c1-87de-f5a2c3ff5471 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:25.829446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93442789-6f90-44c1-87de-f5a2c3ff5471 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:25.834228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:25.834831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:25.835121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:25.835433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:25.844140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:25.870620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097895f-4c74-4452-8365-b272ba9e6f61 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:25.880533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 657/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:27.949111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ac8af-6a5f-41b6-972c-aeae2345cc0c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:27.949645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ac8af-6a5f-41b6-972c-aeae2345cc0c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:27.949764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ac8af-6a5f-41b6-972c-aeae2345cc0c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:27.951390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 658/1315] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:27.956835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef00-f02c-416a-8672-2bb3e15c64b1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:27.957266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef00-f02c-416a-8672-2bb3e15c64b1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:27.957409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef00-f02c-416a-8672-2bb3e15c64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:27.981394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5165ef00-f02c-416a-8672-2bb3e15c64b1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:27.982547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5165ef00-f02c-416a-8672-2bb3e15c64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:27.989727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 658/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:28.075716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ac8af-6a5f-41b6-972c-aeae2345cc0c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:28.089880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ac8af-6a5f-41b6-972c-aeae2345cc0c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:28.094752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:28.095316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:28.095603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:28.095882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:28.104134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:28.128856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686132b8-b0a1-484a-9df2-31454e18daee service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:28.137595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 659/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:30.207956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd0b1-1112-47d6-ba54-9f37b72b9127 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:30.208459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd0b1-1112-47d6-ba54-9f37b72b9127 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:30.208459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dd0b1-1112-47d6-ba54-9f37b72b9127 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:30.210146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 659/1318] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:30.215512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee972e2-c898-4d98-b1ef-a7382d1cd237 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:30.215944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee972e2-c898-4d98-b1ef-a7382d1cd237 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:30.216088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee972e2-c898-4d98-b1ef-a7382d1cd237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:30.239278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1ee972e2-c898-4d98-b1ef-a7382d1cd237 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:30.240450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1ee972e2-c898-4d98-b1ef-a7382d1cd237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:30.248157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 660/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:30.336560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dd0b1-1112-47d6-ba54-9f37b72b9127 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:30.349971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dd0b1-1112-47d6-ba54-9f37b72b9127 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:30.354935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:30.355509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:30.355799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:30.356079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:30.363934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:30.390208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddfef3-8fcc-4fca-905f-9296ddad0286 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:30.399675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 660/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:40.641013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29137f90-7fe8-417b-8064-9d5a75320b6a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.641561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29137f90-7fe8-417b-8064-9d5a75320b6a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.641695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29137f90-7fe8-417b-8064-9d5a75320b6a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.643289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 661/1321] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:40.649663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505722-07d7-41b7-91bd-1101f79eecf5 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.650087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505722-07d7-41b7-91bd-1101f79eecf5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.650246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505722-07d7-41b7-91bd-1101f79eecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.673082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-08505722-07d7-41b7-91bd-1101f79eecf5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:40.674238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-08505722-07d7-41b7-91bd-1101f79eecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:40.681945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 661/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:40.745469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4aef-8365-46cb-b937-8258fc755540 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.745781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4aef-8365-46cb-b937-8258fc755540 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.746068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be4aef-8365-46cb-b937-8258fc755540 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.747797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 662/1323] 10.222.0.48 () {54 vars in 961 bytes} [Fri Apr 8 02:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:40.752854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad641b-1425-4919-ab0e-6ef84b01df55 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.753150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad641b-1425-4919-ab0e-6ef84b01df55 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.753435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad641b-1425-4919-ab0e-6ef84b01df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.822822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-36ad641b-1425-4919-ab0e-6ef84b01df55 None None] MFA Rules not processed for user `1331f8c76c344c1eba589f81eb365d18`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:40.823964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-36ad641b-1425-4919-ab0e-6ef84b01df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:40.890482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 662/1324] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Apr 8 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:40.898379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4aef-8365-46cb-b937-8258fc755540 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:40.908432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be4aef-8365-46cb-b937-8258fc755540 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:40.911702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:40.912302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.912589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.912869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.922445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:40.948951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2cac9-8d4f-4646-a2ea-0a1c2904c95c service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:40.960036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 663/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:54.207909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ff7c-f332-4ad9-b525-9f0932bdc459 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.208513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ff7c-f332-4ad9-b525-9f0932bdc459 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.208513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8ff7c-f332-4ad9-b525-9f0932bdc459 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.210084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 663/1326] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:54.215245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68502-29bc-43a8-a9ed-80fbd174b1f0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.215645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68502-29bc-43a8-a9ed-80fbd174b1f0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.215885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68502-29bc-43a8-a9ed-80fbd174b1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.237723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a0a68502-29bc-43a8-a9ed-80fbd174b1f0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:54.238873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a0a68502-29bc-43a8-a9ed-80fbd174b1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:54.245573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 664/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:54.307473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01101b-e3e2-468f-ae59-c0bf50849dd2 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.307767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01101b-e3e2-468f-ae59-c0bf50849dd2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.308076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01101b-e3e2-468f-ae59-c0bf50849dd2 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.310237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 664/1328] 10.222.0.48 () {54 vars in 961 bytes} [Fri Apr 8 02:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:54.315844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e532c-1a07-4ad0-a496-65b1a095e022 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.316143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e532c-1a07-4ad0-a496-65b1a095e022 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.316430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e532c-1a07-4ad0-a496-65b1a095e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.383051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-561e532c-1a07-4ad0-a496-65b1a095e022 None None] MFA Rules not processed for user `1c47875086994711af245d3b53b617f9`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:54.384178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-561e532c-1a07-4ad0-a496-65b1a095e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:54.449277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 665/1329] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Apr 8 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:54.458812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01101b-e3e2-468f-ae59-c0bf50849dd2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:54.468993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01101b-e3e2-468f-ae59-c0bf50849dd2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:54.472198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:54.472764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.473050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.473330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.482719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:54.508807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5bce-f251-494c-85f9-17788a6126f0 service glance] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:54.517948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 665/1330] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:54.900603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91117-f2c9-4ae6-887b-770a4b8e192e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:54.900906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91117-f2c9-4ae6-887b-770a4b8e192e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:54.901216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea91117-f2c9-4ae6-887b-770a4b8e192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:54.984652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6ea91117-f2c9-4ae6-887b-770a4b8e192e None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:54.985726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6ea91117-f2c9-4ae6-887b-770a4b8e192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:55.056627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 666/1331] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:55.097068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e779-773b-4fd3-a471-8d8bb18e90c1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:55.097411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e779-773b-4fd3-a471-8d8bb18e90c1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:55.097696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e779-773b-4fd3-a471-8d8bb18e90c1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:55.099413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 666/1332] 10.222.0.48 () {54 vars in 942 bytes} [Fri Apr 8 02:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:55.105258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b12c8-c5ba-4b95-9b13-da12f460e73e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:55.105558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b12c8-c5ba-4b95-9b13-da12f460e73e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:55.105878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b12c8-c5ba-4b95-9b13-da12f460e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:55.172080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-316b12c8-c5ba-4b95-9b13-da12f460e73e None None] MFA Rules not processed for user `5f1aa7e27de44da2a1dc7fcb1df0b74c`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:55.173222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-316b12c8-c5ba-4b95-9b13-da12f460e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:55.250970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 667/1333] 10.222.0.48 () {58 vars in 1039 bytes} [Fri Apr 8 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:55.259627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e779-773b-4fd3-a471-8d8bb18e90c1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:55.273428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e779-773b-4fd3-a471-8d8bb18e90c1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:55.277812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:55.279224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:55.279543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:55.279824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:55.287505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:37:55.312889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326fdae-383a-437d-879a-71b2b9d8195b service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:55.320735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 667/1334] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:38:14.193863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01920-fdb2-467b-86d2-e83725877827 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.194431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01920-fdb2-467b-86d2-e83725877827 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.194431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01920-fdb2-467b-86d2-e83725877827 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.196162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 668/1335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:14.201407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe617dad-c995-42ee-84ad-10c023d99097 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.201868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe617dad-c995-42ee-84ad-10c023d99097 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.201975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe617dad-c995-42ee-84ad-10c023d99097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.224862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fe617dad-c995-42ee-84ad-10c023d99097 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:14.225983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fe617dad-c995-42ee-84ad-10c023d99097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:14.233512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 668/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:14.255221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a01920-fdb2-467b-86d2-e83725877827 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:14.267004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a01920-fdb2-467b-86d2-e83725877827 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:14.271218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:14.271792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.272078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.272359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.273048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:14.299311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084c23c-2d92-40a9-90a3-9f6af01adb61 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:14.315166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 669/1337] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:38:14 2022] GET /identity/v3/projects => generated 2553 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:38:16.311033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99c495-4bfc-41d7-99de-128870fcad57 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:16.311561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99c495-4bfc-41d7-99de-128870fcad57 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:16.311561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99c495-4bfc-41d7-99de-128870fcad57 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:16.313210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 669/1338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:16.318297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:16.318757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:16.318900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:16.341599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:16.342781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:16.349626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 670/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:16.371440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99c495-4bfc-41d7-99de-128870fcad57 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:16.383165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99c495-4bfc-41d7-99de-128870fcad57 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:16.387864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:16.388646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:16.388936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:16.389220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] PATH_INFO: `/v3/projects/2eb35e952da64270ba7999460f44e133` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:16.401834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] RBAC: Authorizing `identity:get_project(project_id=2eb35e952da64270ba7999460f44e133)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:16.428560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:16.430252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 670/1340] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:16 2022] GET /identity/v3/projects/2eb35e952da64270ba7999460f44e133 => generated 361 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:38:16.436207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:16.444822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b637fa-b725-4174-9adc-d5f0559ae980 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:16.449005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:16.451031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:16.451328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:16.451612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:16.452339 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] RBAC: Adding query filter params (scope.project.id=2eb35e952da64270ba7999460f44e133) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:16.452639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:16.478481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242419a-b370-4a72-8f84-c0c7730a9bc2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:16.484000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 671/1341] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:16 2022] GET /identity/v3/role_assignments?scope.project.id=2eb35e952da64270ba7999460f44e133 => generated 526 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:16.489607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:16.499740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f4956-223b-4ade-9424-d4ac2ad8ff9b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:16.503953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:16.504748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:16.505039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:16.505324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] PATH_INFO: `/v3/users/3b9f21576c5d4669a5393a2eb5824c90` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:16.524202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b9f21576c5d4669a5393a2eb5824c90)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:16.550929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d631a16-74ac-4a98-b377-d0b238abaf16 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:16.552428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 671/1342] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:16 2022] GET /identity/v3/users/3b9f21576c5d4669a5393a2eb5824c90 => generated 311 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:38:18.584262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432225d-e19b-4d7f-9043-f5946035c63f None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.584819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432225d-e19b-4d7f-9043-f5946035c63f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.584819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432225d-e19b-4d7f-9043-f5946035c63f None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.586498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 672/1343] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:18.591867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.592299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.592434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.615289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:18.616431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:18.623938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 672/1344] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:18.645912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432225d-e19b-4d7f-9043-f5946035c63f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:18.657721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432225d-e19b-4d7f-9043-f5946035c63f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:18.661696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:18.662459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.662776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.663053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] PATH_INFO: `/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.675878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] RBAC: Authorizing `identity:get_project(project_id=44b9f8cc5db14331a52eb044c4aab7f7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:18.701562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:18.703129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 673/1345] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:18 2022] GET /identity/v3/projects/44b9f8cc5db14331a52eb044c4aab7f7 => generated 298 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:18.709196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:18.718437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd330-7f96-428c-9ca2-e0fcc935e24a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:18.722511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:18.723128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.723421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.723705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.724421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] RBAC: Adding query filter params (scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:18.724723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:18.750788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:18.757245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 673/1346] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:18 2022] GET /identity/v3/role_assignments?scope.project.id=44b9f8cc5db14331a52eb044c4aab7f7 => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:38:18.763134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:18.772738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03e3f4-f166-4379-ac5c-7c170810336e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:18.776910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:18.778300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.778590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.778911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.797849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:18.823152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee09e-610e-4d19-9474-906bba8c4e2a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:18.824635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 674/1347] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:18 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:18.830274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:18.840134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5c35-ab5b-4985-9985-198addeca6b7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:18.845324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:18.846108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:18.846407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:18.846732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:18.847809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:18.873750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959bee3-eb74-4870-bd08-03301f6edc4d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:18.875221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 674/1348] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:18 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:20.932145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4fa0-ae47-45ea-adef-e55c9263eea1 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:20.932682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4fa0-ae47-45ea-adef-e55c9263eea1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:20.932796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e4fa0-ae47-45ea-adef-e55c9263eea1 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:20.935241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 675/1349] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:20.940332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:20.940732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:20.940905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:20.963966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:20.965672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:20.972631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 675/1350] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:20.994011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e4fa0-ae47-45ea-adef-e55c9263eea1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:21.011464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e4fa0-ae47-45ea-adef-e55c9263eea1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:21.016313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:21.017120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:21.017407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:21.017683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] PATH_INFO: `/v3/projects/5278c0c01f574ca7a9de0c530680d77c` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:21.030552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] RBAC: Authorizing `identity:get_project(project_id=5278c0c01f574ca7a9de0c530680d77c)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:21.056017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:21.057587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 676/1351] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:20 2022] GET /identity/v3/projects/5278c0c01f574ca7a9de0c530680d77c => generated 311 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:21.064201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:21.072840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4499012-6fac-4766-ab5f-b5d018753345 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:21.077805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:21.078388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:21.078696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:21.078983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:21.079706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] RBAC: Adding query filter params (scope.project.id=5278c0c01f574ca7a9de0c530680d77c) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:21.080008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:21.105633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff7f8c-be89-454e-abfa-93bff32f7d24 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:21.111088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 676/1352] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:21 2022] GET /identity/v3/role_assignments?scope.project.id=5278c0c01f574ca7a9de0c530680d77c => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:21.116780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:21.126809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a486a-b8eb-4acb-a8c2-6ba50299bea8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:21.130841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:21.131624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:21.131911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:21.132190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] PATH_INFO: `/v3/users/443cef1fae604529b51cb1ae854df262` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:21.151269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] RBAC: Authorizing `identity:get_user(user_id=443cef1fae604529b51cb1ae854df262)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:21.176634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c792b1-35a5-4f95-82b8-cd10089b6862 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:21.178111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 677/1353] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:21 2022] GET /identity/v3/users/443cef1fae604529b51cb1ae854df262 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:23.164483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efaecc-b5cf-4bf0-8b66-2cc8a2b95908 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.165029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efaecc-b5cf-4bf0-8b66-2cc8a2b95908 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.165138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efaecc-b5cf-4bf0-8b66-2cc8a2b95908 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.166823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 677/1354] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:23.172392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.172805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.172956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.195680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:23.196812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:23.203773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 678/1355] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:23.227089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efaecc-b5cf-4bf0-8b66-2cc8a2b95908 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:23.239603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efaecc-b5cf-4bf0-8b66-2cc8a2b95908 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:23.243636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:23.244420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.244716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.245002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] PATH_INFO: `/v3/projects/5401064486ed43bab740ef11fb147a85` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.257594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] RBAC: Authorizing `identity:get_project(project_id=5401064486ed43bab740ef11fb147a85)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:23.283574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:23.285124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 678/1356] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:23 2022] GET /identity/v3/projects/5401064486ed43bab740ef11fb147a85 => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:23.291138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:23.300351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e64e6-cf96-4e27-a567-72fd78af4e2e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:23.304373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:23.304943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.305230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.305507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.306226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] RBAC: Adding query filter params (scope.project.id=5401064486ed43bab740ef11fb147a85) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:23.306521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:23.331758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:23.338185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 679/1357] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:23 2022] GET /identity/v3/role_assignments?scope.project.id=5401064486ed43bab740ef11fb147a85 => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:38:23.344622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:23.354273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7fad-af39-4bfc-b550-8cd7e1767928 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:23.359175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:23.359963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.360274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.360560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.361665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:23.386810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34671a-d0d1-4ee2-b86e-8f048f9d1672 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:23.388347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 679/1358] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:23 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:23.394213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:23.404342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28841e-9766-4e23-b3c7-bdd245f4e851 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:23.408388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:23.409166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:23.409449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:23.409729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] PATH_INFO: `/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:23.428594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] RBAC: Authorizing `identity:get_user(user_id=f331d7ea66b64ecf88c0a3742b8c00a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:23.453928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca6ce-fba3-4fdf-a800-9bf1dbc4da88 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:23.455428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 680/1359] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:23 2022] GET /identity/v3/users/f331d7ea66b64ecf88c0a3742b8c00a0 => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:25.499357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ec86-7f3a-4530-abe9-1c5ae3ac8779 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:25.499928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ec86-7f3a-4530-abe9-1c5ae3ac8779 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:25.499928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ec86-7f3a-4530-abe9-1c5ae3ac8779 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:25.501620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 680/1360] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:25.506785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:25.507213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:25.507351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:25.530209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:25.531368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:25.538062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 681/1361] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:25.562698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1ec86-7f3a-4530-abe9-1c5ae3ac8779 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:25.575084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1ec86-7f3a-4530-abe9-1c5ae3ac8779 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:25.579075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:25.579852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:25.580140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:25.580422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] PATH_INFO: `/v3/projects/b654bd89267e40c6bd627b095329b06e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:25.581492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] RBAC: Authorizing `identity:get_project(project_id=b654bd89267e40c6bd627b095329b06e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:25.606797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:25.608310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 681/1362] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:25 2022] GET /identity/v3/projects/b654bd89267e40c6bd627b095329b06e => generated 344 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:25.614179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:25.623344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a876-836b-49b0-a17d-fef6f3071e15 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:25.627404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:25.627978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:25.628261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:25.628546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:25.629270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] RBAC: Adding query filter params (scope.project.id=b654bd89267e40c6bd627b095329b06e) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:25.629568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:25.655632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73148-6b43-4807-9080-96c61a84bb91 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:25.661246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 682/1363] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:25 2022] GET /identity/v3/role_assignments?scope.project.id=b654bd89267e40c6bd627b095329b06e => generated 879 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:25.666694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:25.675796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0208b-cf28-42b1-bdc4-a42ef355abfb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:25.679851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:25.680628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:25.680914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:25.681194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] PATH_INFO: `/v3/users/53f94523980e4b8c8b9272803bd96ee5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:25.682272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] RBAC: Authorizing `identity:get_user(user_id=53f94523980e4b8c8b9272803bd96ee5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:25.707927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab36bfb-283d-4d81-b16c-8b5dddcb44ce admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:25.709414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 682/1364] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:25 2022] GET /identity/v3/users/53f94523980e4b8c8b9272803bd96ee5 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:27.708413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d63e-5be8-496d-bd8f-26b7462ec8f4 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:27.709257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d63e-5be8-496d-bd8f-26b7462ec8f4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:27.709426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4d63e-5be8-496d-bd8f-26b7462ec8f4 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:27.711225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 683/1365] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:27.716987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:27.717388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:27.717554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:27.739750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:27.740861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:27.748615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 683/1366] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:27.770328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4d63e-5be8-496d-bd8f-26b7462ec8f4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:27.782195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4d63e-5be8-496d-bd8f-26b7462ec8f4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:27.786236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:27.787065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:27.787359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:27.787643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] PATH_INFO: `/v3/projects/ee1708718eed48949cddfa4a288076ca` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:27.799905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee1708718eed48949cddfa4a288076ca)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:27.826783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:27.828336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 684/1367] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:27 2022] GET /identity/v3/projects/ee1708718eed48949cddfa4a288076ca => generated 312 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:27.834206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:27.843079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb132e6-8b5c-4c9a-8026-cd1677c7c2e5 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:27.847199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:27.847776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:27.848066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:27.848349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:27.849066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] RBAC: Adding query filter params (scope.project.id=ee1708718eed48949cddfa4a288076ca) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:27.849368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:27.875347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fd1ec-b052-45fc-94bc-71cf9b151fb1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:27.880595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 684/1368] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:27 2022] GET /identity/v3/role_assignments?scope.project.id=ee1708718eed48949cddfa4a288076ca => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:38:27.886108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:27.896599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91cf91-7468-4cad-9221-7a9b52b49f94 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:27.900799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:27.901609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:27.901937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:27.902251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] PATH_INFO: `/v3/users/158f1c26a6c8482b805b78156890152f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:27.903366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] RBAC: Authorizing `identity:get_user(user_id=158f1c26a6c8482b805b78156890152f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:27.928882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37794d-1314-429c-8a79-be7a5cee6cbc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:27.930338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 685/1369] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:27 2022] GET /identity/v3/users/158f1c26a6c8482b805b78156890152f => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:29.929615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5415f68-d957-4a29-842c-b0ce00a61844 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:29.930136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5415f68-d957-4a29-842c-b0ce00a61844 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:29.930233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5415f68-d957-4a29-842c-b0ce00a61844 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:29.931881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 685/1370] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:29.937148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:29.937535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:29.937703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:29.960182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:29.961344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:29.968714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 686/1371] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:29.991350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5415f68-d957-4a29-842c-b0ce00a61844 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:30.003774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5415f68-d957-4a29-842c-b0ce00a61844 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:30.007920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:30.008850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:30.009072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:30.009362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] PATH_INFO: `/v3/projects/ff0558a11bf94e0e99800216ec872b33` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:30.023798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] RBAC: Authorizing `identity:get_project(project_id=ff0558a11bf94e0e99800216ec872b33)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:30.049347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:30.050996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 686/1372] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Apr 8 02:38:29 2022] GET /identity/v3/projects/ff0558a11bf94e0e99800216ec872b33 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:30.057037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:30.066546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d412-ca96-49e0-9e0f-8aaf2b4efe35 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:30.070708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:30.071295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:30.071587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:30.071871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:30.072602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] RBAC: Adding query filter params (scope.project.id=ff0558a11bf94e0e99800216ec872b33) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:38:30.072905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:30.099259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:30.105427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 687/1373] 10.222.0.48 () {56 vars in 1231 bytes} [Fri Apr 8 02:38:30 2022] GET /identity/v3/role_assignments?scope.project.id=ff0558a11bf94e0e99800216ec872b33 => generated 877 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:38:30.111587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:30.122105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37658-b541-432f-b086-6cb8231a2c6c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:30.126315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:30.127138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:30.127429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:30.127709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] PATH_INFO: `/v3/users/a1a0f3787fa142a189f08f05be5af904` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:30.147884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] RBAC: Authorizing `identity:get_user(user_id=a1a0f3787fa142a189f08f05be5af904)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:30.173445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e777053-5163-4f1c-b1f9-9090d2da22fa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:30.175011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 687/1374] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:30 2022] GET /identity/v3/users/a1a0f3787fa142a189f08f05be5af904 => generated 285 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:30.180788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:30.191009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110c900-59ed-495b-8acb-9c28066005c2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:30.195138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:30.195933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:30.196344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:30.196652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] PATH_INFO: `/v3/users/d51809c85b7141c49fafe7823480e54e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:30.216342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] RBAC: Authorizing `identity:get_user(user_id=d51809c85b7141c49fafe7823480e54e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:30.242320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf805e-dfff-4f14-abf4-fa03772a5545 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:30.243869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 688/1375] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Apr 8 02:38:30 2022] GET /identity/v3/users/d51809c85b7141c49fafe7823480e54e => generated 286 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:38:34.882280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026a8c-3d9c-4d56-b6b0-33a22a966240 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:34.882847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026a8c-3d9c-4d56-b6b0-33a22a966240 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:34.882968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026a8c-3d9c-4d56-b6b0-33a22a966240 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:34.884558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 688/1376] 10.222.0.48 () {54 vars in 918 bytes} [Fri Apr 8 02:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:34.889712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9822-645c-48d7-98b0-3492a45ca6f0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:34.890150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9822-645c-48d7-98b0-3492a45ca6f0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:34.890277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee9822-645c-48d7-98b0-3492a45ca6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:34.913988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1cee9822-645c-48d7-98b0-3492a45ca6f0 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:34.919794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1cee9822-645c-48d7-98b0-3492a45ca6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:34.927447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 689/1377] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Apr 8 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:38:34.987819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306130-e2d8-4e98-a447-ef3948a9f392 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:34.988115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306130-e2d8-4e98-a447-ef3948a9f392 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:34.988403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306130-e2d8-4e98-a447-ef3948a9f392 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:34.990080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 689/1378] 10.222.0.48 () {54 vars in 918 bytes} [Fri Apr 8 02:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:34.994969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0136a9-4390-4394-8242-47c7fb6dbdaa None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:34.995297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0136a9-4390-4394-8242-47c7fb6dbdaa None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:34.996314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0136a9-4390-4394-8242-47c7fb6dbdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:35.018636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7f0136a9-4390-4394-8242-47c7fb6dbdaa None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:35.020064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7f0136a9-4390-4394-8242-47c7fb6dbdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:35.027998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 690/1379] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Apr 8 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:38:37.336367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10ce6-4130-4635-b3cc-b90c430e5eb3 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:37.336875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10ce6-4130-4635-b3cc-b90c430e5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:37.336875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10ce6-4130-4635-b3cc-b90c430e5eb3 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:37.338533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:38:37.344317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cf76-1c52-45fa-8374-913342e876bc None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:37.344738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cf76-1c52-45fa-8374-913342e876bc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:37.344878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370cf76-1c52-45fa-8374-913342e876bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:37.366675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1370cf76-1c52-45fa-8374-913342e876bc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:37.367831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1370cf76-1c52-45fa-8374-913342e876bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:37.374725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:38:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:37.460487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10ce6-4130-4635-b3cc-b90c430e5eb3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:37.474529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10ce6-4130-4635-b3cc-b90c430e5eb3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:37.479368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:37.479986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:37.480264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:37.480553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:37.488324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:37.514436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d3225-0b24-425a-9735-ec2b709532e8 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:37.523590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 691/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:38.930630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d0c8-e543-4829-ae70-751339ab2d85 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:38.931224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d0c8-e543-4829-ae70-751339ab2d85 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:38.931224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30d0c8-e543-4829-ae70-751339ab2d85 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:38.933104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:38.937876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ca16-35c2-482e-9fc2-e37487799e1d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:38.938279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ca16-35c2-482e-9fc2-e37487799e1d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:38.938451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1ca16-35c2-482e-9fc2-e37487799e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:38.963071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-90c1ca16-35c2-482e-9fc2-e37487799e1d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:38.964800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-90c1ca16-35c2-482e-9fc2-e37487799e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:38.971910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:39.136907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30d0c8-e543-4829-ae70-751339ab2d85 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:39.150122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30d0c8-e543-4829-ae70-751339ab2d85 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:39.155225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:39.155791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:39.156079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:39.156358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:39.164056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:39.189517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0701-6018-4bc4-b327-74fa9b45d9b8 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:39.198182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 693/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:40.629956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40789-0a7c-43ae-a4a2-e6f2448f4cc7 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:40.630603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40789-0a7c-43ae-a4a2-e6f2448f4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:40.630603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed40789-0a7c-43ae-a4a2-e6f2448f4cc7 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:40.632222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:40.637602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083d3f-1bac-4d1d-a4dd-52db918fbdab None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:40.638054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083d3f-1bac-4d1d-a4dd-52db918fbdab None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:40.638155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083d3f-1bac-4d1d-a4dd-52db918fbdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:40.660526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-18083d3f-1bac-4d1d-a4dd-52db918fbdab None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:40.661669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-18083d3f-1bac-4d1d-a4dd-52db918fbdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:40.668556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:40.816269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40789-0a7c-43ae-a4a2-e6f2448f4cc7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:40.830175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed40789-0a7c-43ae-a4a2-e6f2448f4cc7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:40.835323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:40.835928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:40.836216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:40.836498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:40.844456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:40.871171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33683-a27d-468f-b035-4e16b9690e8b service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:40.880127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 694/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:42.294551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62594c-e478-468c-9459-509d3dc860e0 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:42.295189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62594c-e478-468c-9459-509d3dc860e0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:42.295189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62594c-e478-468c-9459-509d3dc860e0 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:42.296729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:42.301430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cd6d-f202-4842-aabf-3a88fda1c78d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:42.301851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cd6d-f202-4842-aabf-3a88fda1c78d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:42.302034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19cd6d-f202-4842-aabf-3a88fda1c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:42.326285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2c19cd6d-f202-4842-aabf-3a88fda1c78d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:42.327461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2c19cd6d-f202-4842-aabf-3a88fda1c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:42.334317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:38:42.487578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62594c-e478-468c-9459-509d3dc860e0 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:42.501666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62594c-e478-468c-9459-509d3dc860e0 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:42.506362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:42.506961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:42.507252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:42.507528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:42.515396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:42.540561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0376233-8319-43c5-be96-7ae3e0646db2 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:42.550057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 696/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:43.968780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b017d-6b56-42b6-994f-771b5c52102a None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:43.969314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b017d-6b56-42b6-994f-771b5c52102a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:43.969314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b017d-6b56-42b6-994f-771b5c52102a None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:43.971031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:43.975731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdb294-2395-4ef7-8338-1fa3943d3f18 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:43.976157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdb294-2395-4ef7-8338-1fa3943d3f18 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:43.976296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdb294-2395-4ef7-8338-1fa3943d3f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:43.998209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5acdb294-2395-4ef7-8338-1fa3943d3f18 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:43.999365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5acdb294-2395-4ef7-8338-1fa3943d3f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:44.006111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:44.153951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b017d-6b56-42b6-994f-771b5c52102a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:44.168550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b017d-6b56-42b6-994f-771b5c52102a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:44.173394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:44.173967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:44.174256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:44.174536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:44.182392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:44.208600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d77baf-636d-4d89-bd01-1bda5d48decd service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:44.218098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 697/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:45.557160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d393dd-f1ce-4c0a-81f9-9275e9765fdc None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:45.558378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d393dd-f1ce-4c0a-81f9-9275e9765fdc None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:45.558378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d393dd-f1ce-4c0a-81f9-9275e9765fdc None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:45.560091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:45.564816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1da2db-30f5-448e-9af4-40b1c02dc343 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:45.565217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1da2db-30f5-448e-9af4-40b1c02dc343 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:45.565388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1da2db-30f5-448e-9af4-40b1c02dc343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:45.587159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9f1da2db-30f5-448e-9af4-40b1c02dc343 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:45.588285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9f1da2db-30f5-448e-9af4-40b1c02dc343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:45.595071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:45.743139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d393dd-f1ce-4c0a-81f9-9275e9765fdc None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:45.757276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d393dd-f1ce-4c0a-81f9-9275e9765fdc None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:45.762851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:45.763427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:45.763720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:45.764005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:45.772134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:45.799069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0428c8-3aaa-45ba-aaaa-0ee736c1359d service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:45.808651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 699/1397] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:47.163595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d408-98ab-4328-bb85-6c614e8cfad7 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:47.164145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d408-98ab-4328-bb85-6c614e8cfad7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:47.164266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53d408-98ab-4328-bb85-6c614e8cfad7 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:47.165887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:47.171127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e2e-53dd-4c17-895e-2fb14226f323 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:47.171542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e2e-53dd-4c17-895e-2fb14226f323 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:47.171696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e2e-53dd-4c17-895e-2fb14226f323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:47.194128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-323b3e2e-53dd-4c17-895e-2fb14226f323 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:47.195278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-323b3e2e-53dd-4c17-895e-2fb14226f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:47.202062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:47.350194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d408-98ab-4328-bb85-6c614e8cfad7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:47.364343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53d408-98ab-4328-bb85-6c614e8cfad7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:47.369154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:47.369723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:47.370081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:47.370357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:47.378146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:47.404428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f7194-7313-41db-9a93-4ce019518dba service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:47.413314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 700/1400] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:48.775916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c615-8d34-4652-9c22-97b7d1670894 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:48.777175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c615-8d34-4652-9c22-97b7d1670894 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:48.777175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c615-8d34-4652-9c22-97b7d1670894 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:48.778786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:48.783516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe33c-967a-409e-bfe5-36ed4bb32bdf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:48.783895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe33c-967a-409e-bfe5-36ed4bb32bdf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:48.784123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe33c-967a-409e-bfe5-36ed4bb32bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:48.806841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-dedbe33c-967a-409e-bfe5-36ed4bb32bdf None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:48.807921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-dedbe33c-967a-409e-bfe5-36ed4bb32bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:48.815023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:48.965045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c615-8d34-4652-9c22-97b7d1670894 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:48.978419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c615-8d34-4652-9c22-97b7d1670894 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:48.984494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:48.985068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:48.985358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:48.985642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:48.993617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:49.019460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895ff1c-6db3-4977-a765-f0ca7e6f5534 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:49.029650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 702/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:50.369076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3ef-b781-415a-bc9d-91beba1cacd7 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:50.369619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3ef-b781-415a-bc9d-91beba1cacd7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:50.369739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bf3ef-b781-415a-bc9d-91beba1cacd7 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:50.371879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:50.376629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c1de-5e75-4e45-9bc2-cb84c6fe9e6d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:50.377064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c1de-5e75-4e45-9bc2-cb84c6fe9e6d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:50.377195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7c1de-5e75-4e45-9bc2-cb84c6fe9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:50.399930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-dfb7c1de-5e75-4e45-9bc2-cb84c6fe9e6d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:50.401080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-dfb7c1de-5e75-4e45-9bc2-cb84c6fe9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:50.407844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:38:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:50.553196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bf3ef-b781-415a-bc9d-91beba1cacd7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:50.566947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bf3ef-b781-415a-bc9d-91beba1cacd7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:50.571767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:50.572336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:50.572625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:50.573488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:50.581507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:50.607495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443734d0-590d-4384-9b1d-aa817eb80e73 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:50.616262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 703/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:52.540078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626875c8-b8e4-4032-a0e1-d51601a1e6eb None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:52.540617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626875c8-b8e4-4032-a0e1-d51601a1e6eb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:52.540734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626875c8-b8e4-4032-a0e1-d51601a1e6eb None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:52.542373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:52.547588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5eef-90e0-4652-9394-28aed7ea3252 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:52.548016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5eef-90e0-4652-9394-28aed7ea3252 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:52.548167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af5eef-90e0-4652-9394-28aed7ea3252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:52.570926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-80af5eef-90e0-4652-9394-28aed7ea3252 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:52.572066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-80af5eef-90e0-4652-9394-28aed7ea3252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:52.579530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:52.615748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626875c8-b8e4-4032-a0e1-d51601a1e6eb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:52.626597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626875c8-b8e4-4032-a0e1-d51601a1e6eb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:52.629820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:52.630393 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:52.630715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:52.631007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:52.640513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:52.665675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bcd31-b53e-4b07-8265-4e3d3f355110 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:52.674727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 705/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:54.787938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d8f3-86da-47ad-8f0c-f0748890bba9 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:54.788500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d8f3-86da-47ad-8f0c-f0748890bba9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:54.788500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d8f3-86da-47ad-8f0c-f0748890bba9 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:54.790225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:54.796359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96ef1-6c36-49bc-ba11-4fac9ccde8ea None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:54.796765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96ef1-6c36-49bc-ba11-4fac9ccde8ea None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:54.796905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb96ef1-6c36-49bc-ba11-4fac9ccde8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:54.819130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4bb96ef1-6c36-49bc-ba11-4fac9ccde8ea None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:54.820256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4bb96ef1-6c36-49bc-ba11-4fac9ccde8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:54.827449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:54.864825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d8f3-86da-47ad-8f0c-f0748890bba9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:54.875878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d8f3-86da-47ad-8f0c-f0748890bba9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:54.879182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:54.879757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:54.880051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:54.880337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:54.889610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:54.916168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeb1fc-cd4b-45ac-b45a-e269021e6580 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:54.926344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 706/1412] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:57.373305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b27fd0-d36c-4954-8e14-60960954041f None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:57.373852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b27fd0-d36c-4954-8e14-60960954041f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:57.373946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b27fd0-d36c-4954-8e14-60960954041f None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:57.375634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:57.380873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5245-ec2a-4363-85a0-9fe87f17a7ac None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:57.381327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5245-ec2a-4363-85a0-9fe87f17a7ac None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:57.381458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5245-ec2a-4363-85a0-9fe87f17a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:57.404093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bd6c5245-ec2a-4363-85a0-9fe87f17a7ac None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:57.405223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bd6c5245-ec2a-4363-85a0-9fe87f17a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:57.412087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:38:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:57.450658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b27fd0-d36c-4954-8e14-60960954041f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:57.461100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b27fd0-d36c-4954-8e14-60960954041f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:57.464384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:57.465074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:57.465359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:57.465637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:57.474246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:57.500363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b334-5b99-458f-bd52-a37e403db0c5 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:57.509228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 708/1415] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:59.585603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f4790-b6d1-459f-bf8d-c1321c74189e None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:59.586171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f4790-b6d1-459f-bf8d-c1321c74189e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:59.586171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f4790-b6d1-459f-bf8d-c1321c74189e None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:59.587908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:59.593579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945431-fd06-4cb1-a9a1-5215efe44fbd None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:59.594017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945431-fd06-4cb1-a9a1-5215efe44fbd None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:59.594126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945431-fd06-4cb1-a9a1-5215efe44fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:59.616132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a8945431-fd06-4cb1-a9a1-5215efe44fbd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:59.617272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a8945431-fd06-4cb1-a9a1-5215efe44fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:59.624113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:38:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:59.662096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f4790-b6d1-459f-bf8d-c1321c74189e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:59.672481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f4790-b6d1-459f-bf8d-c1321c74189e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:59.675720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:59.676291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:59.676580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:59.676862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:59.685394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:38:59.710901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a48792-8b68-4ff0-b63b-3cc0c66a05a1 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:59.720431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 709/1418] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:01.876449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297ab5-62f9-4903-82b1-54113d98ccf4 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:01.877011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297ab5-62f9-4903-82b1-54113d98ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:01.877011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07297ab5-62f9-4903-82b1-54113d98ccf4 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:01.878708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:01.883862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ef53-5ff8-4f3f-9f02-38eafcc530ff None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:01.884272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ef53-5ff8-4f3f-9f02-38eafcc530ff None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:01.884429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029ef53-5ff8-4f3f-9f02-38eafcc530ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:01.907989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5029ef53-5ff8-4f3f-9f02-38eafcc530ff None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:01.909126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5029ef53-5ff8-4f3f-9f02-38eafcc530ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:01.916083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:01.953126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07297ab5-62f9-4903-82b1-54113d98ccf4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:01.964177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07297ab5-62f9-4903-82b1-54113d98ccf4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:01.968160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:01.968727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:01.969013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:01.969289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:01.978214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:02.003181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e78042-2442-4a6e-92ad-4ba6deac7e50 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:02.013289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 711/1421] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:04.085169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:04.085755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:04.085879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:04.087532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:04.092828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953000f-3898-47d9-9334-34af820896be None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:04.093233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953000f-3898-47d9-9334-34af820896be None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:04.093399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953000f-3898-47d9-9334-34af820896be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:04.115844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e953000f-3898-47d9-9334-34af820896be None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:04.116970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e953000f-3898-47d9-9334-34af820896be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:04.124390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:04.162556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:04.164159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:04.177095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8cc7d-63e5-43a9-b6d6-ea9c7c6910c8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:04.180334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:04.180902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:04.181209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:04.181474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:04.190790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:04.215712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2959-76a3-439e-9d07-75a0dd46eae0 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:04.224556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 712/1424] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:06.396507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed6b-5099-4a2d-b3f0-6721201e78ab None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:06.397066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed6b-5099-4a2d-b3f0-6721201e78ab None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:06.397066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed6b-5099-4a2d-b3f0-6721201e78ab None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:06.398842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:06.404583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e27-440c-4003-b65c-ba5c678aab8e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:06.405002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e27-440c-4003-b65c-ba5c678aab8e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:06.405151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c414e27-440c-4003-b65c-ba5c678aab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:06.429614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9c414e27-440c-4003-b65c-ba5c678aab8e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:06.430843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9c414e27-440c-4003-b65c-ba5c678aab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:06.437946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:06.477018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eed6b-5099-4a2d-b3f0-6721201e78ab None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:06.488375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eed6b-5099-4a2d-b3f0-6721201e78ab None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:06.491669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:06.492253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:06.492540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:06.492824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:06.503089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:06.530244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1fca-6bb3-48c0-bc0c-a0f79637eb50 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:06.539458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 714/1427] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:08.559376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358ea-1854-4ec0-9573-3a2848dbdee8 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:08.559948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358ea-1854-4ec0-9573-3a2848dbdee8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:08.559948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26358ea-1854-4ec0-9573-3a2848dbdee8 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:08.561665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:08.566963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d441ad-3e8b-44f8-b429-4f6f0090c515 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:08.567413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d441ad-3e8b-44f8-b429-4f6f0090c515 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:08.567547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d441ad-3e8b-44f8-b429-4f6f0090c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:08.591387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e5d441ad-3e8b-44f8-b429-4f6f0090c515 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:08.592526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e5d441ad-3e8b-44f8-b429-4f6f0090c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:08.599278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:08.635696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26358ea-1854-4ec0-9573-3a2848dbdee8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:08.646866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26358ea-1854-4ec0-9573-3a2848dbdee8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:08.650081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:08.650685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:08.650998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:08.651285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:08.660704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:08.685835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426d13c-2695-4551-a1f4-c1a34d40a3d0 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:08.694692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 715/1430] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:39:10.690271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc566fa-f4ba-4174-a4e1-4a84397b754c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:10.690882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc566fa-f4ba-4174-a4e1-4a84397b754c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:10.690882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc566fa-f4ba-4174-a4e1-4a84397b754c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:10.692600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:10.697767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c9d-91e1-4654-b3d0-12ee2870d31a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:10.698183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c9d-91e1-4654-b3d0-12ee2870d31a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:10.698341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c9d-91e1-4654-b3d0-12ee2870d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:10.721025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-33dd1c9d-91e1-4654-b3d0-12ee2870d31a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:10.722152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-33dd1c9d-91e1-4654-b3d0-12ee2870d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:10.729071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:10.765353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc566fa-f4ba-4174-a4e1-4a84397b754c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:10.775931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc566fa-f4ba-4174-a4e1-4a84397b754c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:10.779506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:10.780073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:10.780357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:10.780634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:10.789060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:10.814922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2feefb-0bfe-45e8-a6bc-f9bd645e1ada service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:10.823726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 717/1433] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:12.856200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e09e9-5763-4cb0-bc14-3bab0d9eb3b0 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:12.856801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e09e9-5763-4cb0-bc14-3bab0d9eb3b0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:12.856801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e09e9-5763-4cb0-bc14-3bab0d9eb3b0 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:12.858441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:12.863911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32513d2-3be8-4d93-996a-5fd83c34d8ad None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:12.864323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32513d2-3be8-4d93-996a-5fd83c34d8ad None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:12.864502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32513d2-3be8-4d93-996a-5fd83c34d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:12.887899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a32513d2-3be8-4d93-996a-5fd83c34d8ad None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:12.889038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a32513d2-3be8-4d93-996a-5fd83c34d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:12.896182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:12.931445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e09e9-5763-4cb0-bc14-3bab0d9eb3b0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:12.942440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e09e9-5763-4cb0-bc14-3bab0d9eb3b0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:12.945820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:12.946392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:12.946703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:12.946992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:12.956240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:12.981820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec81cd-f7bf-44e9-ab4e-2cff7cd6e775 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:12.991243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 718/1436] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:39:24.571409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520f9-cabb-4be1-9bb7-8bb3596c1d45 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:24.571992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520f9-cabb-4be1-9bb7-8bb3596c1d45 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:24.571992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520f9-cabb-4be1-9bb7-8bb3596c1d45 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:24.573782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 719/1437] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:24.578987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7208e-c78e-4759-934b-aaaaf41e34a4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:24.579434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7208e-c78e-4759-934b-aaaaf41e34a4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:24.579545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7208e-c78e-4759-934b-aaaaf41e34a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:24.601458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7ff7208e-c78e-4759-934b-aaaaf41e34a4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:24.602596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7ff7208e-c78e-4759-934b-aaaaf41e34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:24.610000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 719/1438] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:24.655281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5520f9-cabb-4be1-9bb7-8bb3596c1d45 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:24.665539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5520f9-cabb-4be1-9bb7-8bb3596c1d45 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:24.668852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:24.669417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:24.669705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:24.669985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:24.678411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:24.704466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4128b97-7930-41b4-9366-bef3d5bb8753 service glance] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:24.713292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 720/1439] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:26.788669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d172ef-8a5e-4a34-838d-d183e4f777ed None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:26.789246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d172ef-8a5e-4a34-838d-d183e4f777ed None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:26.789246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d172ef-8a5e-4a34-838d-d183e4f777ed None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:26.790951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 720/1440] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:26.796669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153dc2-7a69-4772-af67-c4e0c52ec5c9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:26.797073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153dc2-7a69-4772-af67-c4e0c52ec5c9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:26.797242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153dc2-7a69-4772-af67-c4e0c52ec5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:26.821076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2e153dc2-7a69-4772-af67-c4e0c52ec5c9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:26.822209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e153dc2-7a69-4772-af67-c4e0c52ec5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:26.829120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 721/1441] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:39:26.850634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d172ef-8a5e-4a34-838d-d183e4f777ed None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:26.862869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d172ef-8a5e-4a34-838d-d183e4f777ed None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:26.866866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:26.867462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:26.867732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:26.868017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:26.868705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:26.895700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ea474-1b7d-4d79-8881-b85a0c50e74d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:26.910865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 721/1442] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Apr 8 02:39:26 2022] GET /identity/v3/projects => generated 2553 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:39:28.430026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c93a9-e479-4b8e-9fba-f5bc9b755140 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:28.430586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c93a9-e479-4b8e-9fba-f5bc9b755140 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:28.430586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c93a9-e479-4b8e-9fba-f5bc9b755140 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:28.433212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 722/1443] 10.222.0.48 () {54 vars in 911 bytes} [Fri Apr 8 02:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:28.437782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58616-156d-4eb8-bd8e-3c9fa7109fcf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:28.438210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58616-156d-4eb8-bd8e-3c9fa7109fcf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:28.438354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58616-156d-4eb8-bd8e-3c9fa7109fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:28.460031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-30c58616-156d-4eb8-bd8e-3c9fa7109fcf None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:28.461171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-30c58616-156d-4eb8-bd8e-3c9fa7109fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:28.468490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 722/1444] 10.222.0.48 () {58 vars in 1008 bytes} [Fri Apr 8 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:28.614600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c93a9-e479-4b8e-9fba-f5bc9b755140 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:28.628471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c93a9-e479-4b8e-9fba-f5bc9b755140 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:28.633203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:28.633767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:28.634053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:28.634328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:28.642901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:28.668309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a9312-d220-4768-b8de-5383d069037a service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:28.677014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 723/1445] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:30.689009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a997-7ecd-4e29-9001-b6091371386f None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:30.689577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a997-7ecd-4e29-9001-b6091371386f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:30.689577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a997-7ecd-4e29-9001-b6091371386f None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:30.691300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 723/1446] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:30.696627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20389-f790-4686-be42-816e776e1e89 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:30.697010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20389-f790-4686-be42-816e776e1e89 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:30.697194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20389-f790-4686-be42-816e776e1e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:30.719573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-10d20389-f790-4686-be42-816e776e1e89 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:30.720698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-10d20389-f790-4686-be42-816e776e1e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:30.727459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 724/1447] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:30.762880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a997-7ecd-4e29-9001-b6091371386f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:30.773556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a997-7ecd-4e29-9001-b6091371386f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:30.777360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:30.777934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:30.778225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:30.778509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:30.787338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:30.813277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cd656-2266-4aea-8834-4ade012bfff9 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:30.822152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 724/1448] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:39:32.868996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cdb1-f3f8-4768-958d-13449baf046c None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:32.870137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cdb1-f3f8-4768-958d-13449baf046c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:32.870245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9cdb1-f3f8-4768-958d-13449baf046c None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:32.871912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 725/1449] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:32.877008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c34c-c464-4ab8-8b14-3ab52c79b3c8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:32.877408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c34c-c464-4ab8-8b14-3ab52c79b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:32.877606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c34c-c464-4ab8-8b14-3ab52c79b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:32.901377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-59a2c34c-c464-4ab8-8b14-3ab52c79b3c8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:32.902516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-59a2c34c-c464-4ab8-8b14-3ab52c79b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:32.909460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 725/1450] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:32.947228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9cdb1-f3f8-4768-958d-13449baf046c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:32.957796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9cdb1-f3f8-4768-958d-13449baf046c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:32.961030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:32.961666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:32.961957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:32.962233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:32.971740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:32.997157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e64a85-66bb-49a3-9d84-9bac2d0b128c service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:33.006463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 726/1451] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:35.114882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59429-8c03-428b-8a96-e802bd1f095a None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:35.115451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59429-8c03-428b-8a96-e802bd1f095a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:35.115451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f59429-8c03-428b-8a96-e802bd1f095a None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:35.117102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 726/1452] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:35.123080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c890-55bf-4829-912b-c2fa176e5eb4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:35.123510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c890-55bf-4829-912b-c2fa176e5eb4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:35.123653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5c890-55bf-4829-912b-c2fa176e5eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:35.146508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c3a5c890-55bf-4829-912b-c2fa176e5eb4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:35.147691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c3a5c890-55bf-4829-912b-c2fa176e5eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:35.154808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 727/1453] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:39:35.194946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f59429-8c03-428b-8a96-e802bd1f095a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:35.205279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f59429-8c03-428b-8a96-e802bd1f095a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:35.208526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:35.209099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:35.209393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:35.209679 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:35.218778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:35.244479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddefb65-805c-4b76-ab1b-a9fcc0bfe19a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:35.253558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 727/1454] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:37.500572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f2d9-08b6-484b-9ac0-87f6efa8fe38 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:37.501115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f2d9-08b6-484b-9ac0-87f6efa8fe38 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:37.501115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f2d9-08b6-484b-9ac0-87f6efa8fe38 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:37.502854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 728/1455] 10.222.0.48 () {54 vars in 926 bytes} [Fri Apr 8 02:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:37.508014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf326b-5265-4ede-b0e6-5ba11d0ae45f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:37.508444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf326b-5265-4ede-b0e6-5ba11d0ae45f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:37.508588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf326b-5265-4ede-b0e6-5ba11d0ae45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:37.532018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7aaf326b-5265-4ede-b0e6-5ba11d0ae45f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:37.533190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7aaf326b-5265-4ede-b0e6-5ba11d0ae45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:37.540123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 728/1456] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Apr 8 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:37.578552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f2d9-08b6-484b-9ac0-87f6efa8fe38 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:37.588923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f2d9-08b6-484b-9ac0-87f6efa8fe38 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:37.592148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:37.592713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:37.593000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:37.593279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:37.601959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:39:37.629046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a603e3-6024-4d11-b9c4-6547a999d6f6 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:37.639497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 729/1457] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:40:55.144866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.145452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.145452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.167989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:40:55.169130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:55.176054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 729/1458] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:40:55.184943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.185793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.186078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.208644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:40:55.209771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:55.217022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 730/1459] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:40:55.221715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.231441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe2fe7-0215-4d31-bec0-6c19befd0f62 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.235560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.236084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.236371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.236672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.237359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:40:55.237665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.263532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.277025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 730/1460] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:40:55.285241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.294652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa02ca-cc8c-41ab-93d0-78f141860bd3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.299050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.299656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.299943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.300220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.300890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.326673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.364269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 731/1461] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:40:55 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:40:55.369148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.378569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64b1ff-c840-47c4-a0b5-e75ed5028e26 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.440267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.440872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.441168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.441454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.442094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.469133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.489087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 731/1462] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:40:55 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:40:55.493540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.503326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c83e2-ac7d-4d3c-936f-300f22f75027 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.507566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.508157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.508450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.508737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.509432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.535384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aefc99-00f6-4261-aa5d-659f75fc499e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.546368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 732/1463] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:40:55.550452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.559696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4e1a-c07d-44a3-be1e-ff7596565464 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.563760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.564565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.564850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.565130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] PATH_INFO: `/v3/projects/d0b0e0e7df194993bebe03a8838b2692/users/2eeba1a9a04d4828aaf6056750088ea0/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.584269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b0e0e7df194993bebe03a8838b2692, user_id=2eeba1a9a04d4828aaf6056750088ea0, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.612213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.627039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 732/1464] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:40:55 2022] PUT /identity/v3/projects/d0b0e0e7df194993bebe03a8838b2692/users/2eeba1a9a04d4828aaf6056750088ea0/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:40:55.638637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678834-9815-40f4-b9d2-babb5b347426 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.638968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678834-9815-40f4-b9d2-babb5b347426 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.639251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678834-9815-40f4-b9d2-babb5b347426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.676086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ea678834-9815-40f4-b9d2-babb5b347426 None None] MFA Rules not processed for user `2eeba1a9a04d4828aaf6056750088ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:40:55.677228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ea678834-9815-40f4-b9d2-babb5b347426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:55.746603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 733/1465] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:40:55.756960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:55.831321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36bac3-628f-4b20-bce3-02d302b0b908 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:55.836864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:55.837437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.837726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.838009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.845445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:55.870235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:55.878426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 733/1466] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:40:55 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:40:55.956674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1cc1e-9084-4fb1-a336-98fd7b0e6739 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:55.956972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1cc1e-9084-4fb1-a336-98fd7b0e6739 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:55.957257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1cc1e-9084-4fb1-a336-98fd7b0e6739 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:55.959165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 734/1467] 10.222.0.48 () {52 vars in 829 bytes} [Fri Apr 8 02:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:40:55.964200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:56.034233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5207e-5729-4802-8a07-56031a5735f9 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:56.038601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:56.039505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:56.039797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:56.040105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] PATH_INFO: `/v3/users/2eeba1a9a04d4828aaf6056750088ea0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:56.041213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeba1a9a04d4828aaf6056750088ea0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:56.065771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:40:56.065771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:40:56.065771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:40:56.066977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:56.128498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeba1a9a04d4828aaf6056750088ea0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.145050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeba1a9a04d4828aaf6056750088ea0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.145680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeba1a9a04d4828aaf6056750088ea0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.146370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeba1a9a04d4828aaf6056750088ea0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.156820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeba1a9a04d4828aaf6056750088ea0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.170229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 734/1468] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:40:55 2022] DELETE /identity/v3/users/2eeba1a9a04d4828aaf6056750088ea0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:40:56.174566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:56.174896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:56.175169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:56.197408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:40:56.198544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:56.260995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 735/1469] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:40:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:40:56.271169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:56.272478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:56.334050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8f8aa-5834-437a-97c3-2e5fea8e4819 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:56.337857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:56.338430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:56.338746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:56.339031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:56.347485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:56.373521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd41a7-fc0c-4a75-8624-9d5a467d2ecb service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:56.382761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 735/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:40:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:40:56.787715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:40:56.789281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:40:56.800094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a98d12-8970-4d55-9a9f-092f40286c1c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:40:56.804363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:40:56.805280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:40:56.805557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:40:56.805837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] PATH_INFO: `/v3/projects/d0b0e0e7df194993bebe03a8838b2692` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:40:56.806941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b0e0e7df194993bebe03a8838b2692)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:40:56.832061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:40:56.832061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:40:56.832061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:40:56.833237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:40:56.888801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b0e0e7df194993bebe03a8838b2692', 'request_id': 'req-af9fa294-e22b-401c-850e-1f5d216b01f3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.894045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b0e0e7df194993bebe03a8838b2692', 'request_id': 'req-af9fa294-e22b-401c-850e-1f5d216b01f3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.905697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b0e0e7df194993bebe03a8838b2692', 'request_id': 'req-af9fa294-e22b-401c-850e-1f5d216b01f3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.918594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] The token cache is being invalidate because project d0b0e0e7df194993bebe03a8838b2692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:40:56.918905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.919568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-af9fa294-e22b-401c-850e-1f5d216b01f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:40:56.920957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 736/1471] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:40:56 2022] DELETE /identity/v3/projects/d0b0e0e7df194993bebe03a8838b2692 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:42:31.632124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:31.632723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:31.632723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:31.634421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:31.639828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bb77-19e1-4e93-98c0-d1a613af9a10 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:31.640305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bb77-19e1-4e93-98c0-d1a613af9a10 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:31.640418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bb77-19e1-4e93-98c0-d1a613af9a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:31.664311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5709bb77-19e1-4e93-98c0-d1a613af9a10 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:31.665455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5709bb77-19e1-4e93-98c0-d1a613af9a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:31.728447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:42:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:31.881411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:31.883066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:31.961557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541197-4944-4380-8cde-6f4b01c095ec None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:31.966436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:31.967045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:31.967334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:31.967614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:31.975508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:32.001320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cee30-7c59-4072-bd51-3243b567d6cf service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:32.012032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 737/1474] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:32.379310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ba47-f82f-47a3-a8d4-f1490e2a3105 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:32.379780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ba47-f82f-47a3-a8d4-f1490e2a3105 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:32.380146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ba47-f82f-47a3-a8d4-f1490e2a3105 None None] PATH_INFO: `/v3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:32.381533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 738/1475] 10.222.0.49 () {54 vars in 925 bytes} [Fri Apr 8 02:42:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:42:32.387538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02f70-1eea-487b-9755-e36d29b42027 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:32.387841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02f70-1eea-487b-9755-e36d29b42027 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:32.388127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02f70-1eea-487b-9755-e36d29b42027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:32.411534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c4e02f70-1eea-487b-9755-e36d29b42027 None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:32.412678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c4e02f70-1eea-487b-9755-e36d29b42027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:32.486103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 738/1476] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Apr 8 02:42:32 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:33.368331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676a6e-9d00-4a6f-b3d8-5d9dd0b76470 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:33.369408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676a6e-9d00-4a6f-b3d8-5d9dd0b76470 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:33.369513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676a6e-9d00-4a6f-b3d8-5d9dd0b76470 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:33.371167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:42:33.375905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad14b-4086-4c9c-bbd0-edc6c0da9c9b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:33.376310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad14b-4086-4c9c-bbd0-edc6c0da9c9b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:33.376471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad14b-4086-4c9c-bbd0-edc6c0da9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:33.399156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-03cad14b-4086-4c9c-bbd0-edc6c0da9c9b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:33.400302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-03cad14b-4086-4c9c-bbd0-edc6c0da9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:33.407425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:33.558109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676a6e-9d00-4a6f-b3d8-5d9dd0b76470 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:33.571588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676a6e-9d00-4a6f-b3d8-5d9dd0b76470 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:33.576983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:33.577583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:33.577873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:33.578156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:33.586471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:33.612982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690a41-617d-461b-8119-97817e3313e6 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:33.623260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 740/1479] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:36.018758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071fde-ec9d-4281-ac43-945238d10122 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:36.019226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071fde-ec9d-4281-ac43-945238d10122 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:36.019364 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25071fde-ec9d-4281-ac43-945238d10122 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:36.021073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 740/1480] 10.222.0.48 () {54 vars in 960 bytes} [Fri Apr 8 02:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:36.026633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3230-ceed-4508-8df6-56007c03480c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:36.027509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3230-ceed-4508-8df6-56007c03480c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:36.027797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3230-ceed-4508-8df6-56007c03480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:36.052959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d4ff3230-ceed-4508-8df6-56007c03480c None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:36.054147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d4ff3230-ceed-4508-8df6-56007c03480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:36.062547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 741/1481] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Apr 8 02:42:36 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:36.070421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25071fde-ec9d-4281-ac43-945238d10122 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:36.085250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25071fde-ec9d-4281-ac43-945238d10122 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:36.091203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:36.091815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:36.092100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:36.092382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:36.100569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:36.126284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23137bca-1f90-4b29-9a6d-7dd6f0e19123 service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:36.136151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 741/1482] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:36 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:45.398093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23367-02d6-4445-ab4d-4efc15358929 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:45.398638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23367-02d6-4445-ab4d-4efc15358929 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:45.398638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf23367-02d6-4445-ab4d-4efc15358929 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:45.401064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:45.405932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f2b1-8439-4608-8f7a-496b0cedab76 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:45.406352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f2b1-8439-4608-8f7a-496b0cedab76 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:45.406493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f2b1-8439-4608-8f7a-496b0cedab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:45.429265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8065f2b1-8439-4608-8f7a-496b0cedab76 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:45.430391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8065f2b1-8439-4608-8f7a-496b0cedab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:45.437458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:42:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:45.585516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf23367-02d6-4445-ab4d-4efc15358929 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:45.599491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf23367-02d6-4445-ab4d-4efc15358929 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:45.604322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:45.605019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:45.605307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:45.605583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:45.613255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:45.638927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474f86-91f1-4e01-b9a9-31cf785f3ef8 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:45.647949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 743/1485] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:47.001428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d711b-535e-41bc-9a78-5928b880228c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:47.002020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d711b-535e-41bc-9a78-5928b880228c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:47.002020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d711b-535e-41bc-9a78-5928b880228c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:47.003693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:47.008535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea9d-7e9f-4170-87be-46906294d271 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:47.008978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea9d-7e9f-4170-87be-46906294d271 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:47.009080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea9d-7e9f-4170-87be-46906294d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:47.034577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-af80ea9d-7e9f-4170-87be-46906294d271 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:47.035758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-af80ea9d-7e9f-4170-87be-46906294d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:47.043052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:42:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:42:47.191212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d711b-535e-41bc-9a78-5928b880228c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:47.205446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d711b-535e-41bc-9a78-5928b880228c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:47.210334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:47.210950 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:47.211242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:47.211528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:47.220575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:47.245656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41672ce-2605-4dd0-8fed-8721c31eee47 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:47.254796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 744/1488] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:51.324205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:51.324730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:51.324730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:51.326378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:51.331583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0ac5-1aa1-4df2-bca1-5f127288c09c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:51.332019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0ac5-1aa1-4df2-bca1-5f127288c09c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:51.332151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0ac5-1aa1-4df2-bca1-5f127288c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:51.355707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-20ec0ac5-1aa1-4df2-bca1-5f127288c09c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:51.356821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-20ec0ac5-1aa1-4df2-bca1-5f127288c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:51.363627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:42:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:51.399028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:51.400556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:51.464556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996af50-1630-43c0-83f9-5221ca0fde57 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:51.467797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:51.468364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:51.468650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:51.468927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:51.477951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:51.503320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948d707-d78b-4efb-a20c-e5c54b23d30b service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:51.512916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 746/1491] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:53.499924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7052-4869-40ce-acca-6bf108e13735 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:53.500496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7052-4869-40ce-acca-6bf108e13735 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:53.500608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7052-4869-40ce-acca-6bf108e13735 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:53.502249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:53.507429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bebea-a855-4df0-91f1-278a52e626d8 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:53.507860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bebea-a855-4df0-91f1-278a52e626d8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:53.507976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bebea-a855-4df0-91f1-278a52e626d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:53.531248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-eb5bebea-a855-4df0-91f1-278a52e626d8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:53.532382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-eb5bebea-a855-4df0-91f1-278a52e626d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:53.539199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:42:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:53.576913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7052-4869-40ce-acca-6bf108e13735 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:53.587352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7052-4869-40ce-acca-6bf108e13735 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:53.590776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:53.591355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:53.591649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:53.591934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:53.600534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:53.626092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f17bad-e61c-4d58-bdbc-209e551c4854 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:53.635002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 747/1494] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:57.228148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:57.228673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:57.228673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:57.230540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:57.235615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737ebd-ccb1-4410-87d4-55ba6c014c1e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:57.236067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737ebd-ccb1-4410-87d4-55ba6c014c1e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:57.236202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737ebd-ccb1-4410-87d4-55ba6c014c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:57.261124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5a737ebd-ccb1-4410-87d4-55ba6c014c1e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:57.262247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5a737ebd-ccb1-4410-87d4-55ba6c014c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:57.269367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:42:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:42:57.325535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:57.327117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:57.393682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee932a6f-560d-49a3-89d4-df3d1cdc30a7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:57.397005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:57.397578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:57.397864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:57.398142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:57.406644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:57.431449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650035a-382a-4432-adb1-1505b9a0bc19 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:57.441033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 749/1497] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:42:59.411750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59076f9-c2cc-44a4-9993-ec5532470390 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:59.412332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59076f9-c2cc-44a4-9993-ec5532470390 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:59.412332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59076f9-c2cc-44a4-9993-ec5532470390 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:59.413984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:59.419162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a52-186e-48ce-bf32-2c323ff6b51b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:59.419590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a52-186e-48ce-bf32-2c323ff6b51b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:59.419762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3a52-186e-48ce-bf32-2c323ff6b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:59.442758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c6fb3a52-186e-48ce-bf32-2c323ff6b51b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:59.443834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c6fb3a52-186e-48ce-bf32-2c323ff6b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:59.451326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:42:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:59.506628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563730-d5bf-4906-bf1b-17121148f66c None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:59.506952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563730-d5bf-4906-bf1b-17121148f66c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:59.507235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563730-d5bf-4906-bf1b-17121148f66c None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:59.508885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 750/1500] 10.222.0.48 () {54 vars in 961 bytes} [Fri Apr 8 02:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:42:59.514121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47707f-025e-4b87-a692-a7a7f5952e01 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:59.514413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47707f-025e-4b87-a692-a7a7f5952e01 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:59.514711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47707f-025e-4b87-a692-a7a7f5952e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:59.536757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-be47707f-025e-4b87-a692-a7a7f5952e01 None None] MFA Rules not processed for user `1331f8c76c344c1eba589f81eb365d18`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:42:59.537874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-be47707f-025e-4b87-a692-a7a7f5952e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:42:59.543736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 751/1501] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Apr 8 02:42:59 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:42:59.551404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563730-d5bf-4906-bf1b-17121148f66c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:42:59.562203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563730-d5bf-4906-bf1b-17121148f66c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:42:59.565508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:42:59.566090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:42:59.566405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:42:59.566708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:42:59.575947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:42:59.600958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c4f3-0b0f-461f-8956-6b6ac22ee9d8 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:42:59.609864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 751/1502] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:42:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:28.986105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.987102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.987748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.026976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.028317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.044072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 752/1503] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.056040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89889-234c-4a47-9f22-bc5169cfb025 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.056957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89889-234c-4a47-9f22-bc5169cfb025 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.057739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89889-234c-4a47-9f22-bc5169cfb025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.093340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1ff89889-234c-4a47-9f22-bc5169cfb025 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.094962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1ff89889-234c-4a47-9f22-bc5169cfb025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.108737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 752/1504] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.113339 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.125041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1621-0769-45e4-bb53-c2fd7a6e2871 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.129156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d38b-d7f2-46e1-9dec-8fafdc955a2a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.129453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d38b-d7f2-46e1-9dec-8fafdc955a2a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.129736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412d38b-d7f2-46e1-9dec-8fafdc955a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.138318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.145510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.145839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.146094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.147018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.148001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.176425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8412d38b-d7f2-46e1-9dec-8fafdc955a2a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.177594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8412d38b-d7f2-46e1-9dec-8fafdc955a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.197329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 753/1505] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.198709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151cabe-f6aa-40b7-abd9-353bda41129a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.199016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151cabe-f6aa-40b7-abd9-353bda41129a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.199428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151cabe-f6aa-40b7-abd9-353bda41129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.203617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b8ee2-0ae3-461e-9f6a-712ddb78a593 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.234048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 753/1506] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.237847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.238087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.238376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.245932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2151cabe-f6aa-40b7-abd9-353bda41129a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.247410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2151cabe-f6aa-40b7-abd9-353bda41129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.258975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 754/1507] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.260411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02130ed5-861e-450b-b3ea-c1bd63b35494 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.260707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02130ed5-861e-450b-b3ea-c1bd63b35494 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.260987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02130ed5-861e-450b-b3ea-c1bd63b35494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.286923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.288782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.298392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-02130ed5-861e-450b-b3ea-c1bd63b35494 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.300274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-02130ed5-861e-450b-b3ea-c1bd63b35494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.310693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 754/1508] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.310693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.314712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 755/1509] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.317433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60578-4630-473b-a038-b4b4a786bec5 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.317740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60578-4630-473b-a038-b4b4a786bec5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.318030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60578-4630-473b-a038-b4b4a786bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.320742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f409-0598-4a2a-a41b-8d5dfca0af74 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.326760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.327359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.327649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.327930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.328564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.341930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-70b60578-4630-473b-a038-b4b4a786bec5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.343118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-70b60578-4630-473b-a038-b4b4a786bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.349956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 756/1510] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.351548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a454eb-e71e-4e71-867d-67de2bf0031d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.351843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a454eb-e71e-4e71-867d-67de2bf0031d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.352127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a454eb-e71e-4e71-867d-67de2bf0031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.356321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eb626-17c4-4743-91d0-70f975560a33 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.374012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b1a454eb-e71e-4e71-867d-67de2bf0031d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.375258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b1a454eb-e71e-4e71-867d-67de2bf0031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.383240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 757/1511] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.384568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.384868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.385155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.388237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 755/1512] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.389501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a262-ea66-4946-a6b6-835dee3932ac None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.389802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a262-ea66-4946-a6b6-835dee3932ac None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.390082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a262-ea66-4946-a6b6-835dee3932ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.408196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.409400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.418318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-21e8a262-ea66-4946-a6b6-835dee3932ac None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.419518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-21e8a262-ea66-4946-a6b6-835dee3932ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.474367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 758/1513] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.483578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.484281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2f3b0-1665-4d91-a910-b84d2b323d35 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.488442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.488963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.489303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.489588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.490270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.491092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.503520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 756/1514] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.503520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcb45-9dfd-4238-8635-51b0655add83 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.503520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcb45-9dfd-4238-8635-51b0655add83 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.503520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afcb45-9dfd-4238-8635-51b0655add83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.517241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.519439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-29afcb45-9dfd-4238-8635-51b0655add83 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.520586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-29afcb45-9dfd-4238-8635-51b0655add83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.528104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 757/1515] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.535483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 759/1516] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.535483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.535750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5212-0670-44ba-89df-b78c33c4f9bb None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.535750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5212-0670-44ba-89df-b78c33c4f9bb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.535750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e5212-0670-44ba-89df-b78c33c4f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.545542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de401bb-3829-423e-8072-471eecac3f87 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.549855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.550438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.550756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.551046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.551735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.552041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.557176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4d0e5212-0670-44ba-89df-b78c33c4f9bb None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.558301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4d0e5212-0670-44ba-89df-b78c33c4f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.565096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 758/1517] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.566212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa478-af1c-4b2a-936b-51a5e871a7f3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.566510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa478-af1c-4b2a-936b-51a5e871a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.566820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa478-af1c-4b2a-936b-51a5e871a7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.578827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.590509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-078fa478-af1c-4b2a-936b-51a5e871a7f3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.591670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-078fa478-af1c-4b2a-936b-51a5e871a7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.591956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 760/1518] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.592740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.598692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 759/1519] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.599804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9ff1-957b-4122-b562-1937b75b5bc0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.600119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9ff1-957b-4122-b562-1937b75b5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.600401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b9ff1-957b-4122-b562-1937b75b5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.603048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9e3-2e27-4056-8eb7-b6ac2ace333c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.607225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.607820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.608111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.608395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.609023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.622693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-443b9ff1-957b-4122-b562-1937b75b5bc0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.623811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-443b9ff1-957b-4122-b562-1937b75b5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.630602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 760/1520] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.632034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.632325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.632607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.635254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.654816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.655865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 761/1521] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.656016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.656851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.663186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 761/1522] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.667106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df859be-08c8-4215-b639-48fad22c1279 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.667365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.671339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.671923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.672214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.672497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.673193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.673493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.676179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef712c-f9e7-417b-9b7b-a92a841f21c3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.680838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.681405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.681690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.681965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.682589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.700138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4268fb-a801-4837-9cac-2ff0ca6ff21f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.708559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.715421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 762/1523] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.716442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.716735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.717021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.742254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 762/1524] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.742254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.742534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.742534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.806089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 763/1525] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.806392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6cc56-fa98-4a36-8327-8f0699467f9d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.807086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.810655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.811405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.811696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.811980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.812617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.816031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f770d-f2f8-495f-8c70-c7e31ccb4a32 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.820475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.821057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.821349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.821635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.822317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.822621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.838328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.847791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.861678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 764/1526] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.862552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.864826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 763/1527] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.865474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.875266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0be6-ebfc-4b0a-ada1-8d4866df0ac5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.934677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471521d9-a376-4c81-97fe-2602294ed269 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.936753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.937351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.937640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.937919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.938603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.938929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.939307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.939909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.940195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.940476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.941170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:29.965839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.967179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.985444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 765/1528] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:29.985638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 764/1529] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:29.985638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.985831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.991787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde996-0fe6-462d-89bd-d75f44bdefac admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.996264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fd798-bb98-4b00-9892-b0c6b279fe2b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.996915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.997071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.997303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.997529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.998272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:29.998573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.001987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.002802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.003151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.003574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.004256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.025169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.032349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.038526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 766/1530] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:30.039334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.048366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9452453-0657-4433-8618-1fd96e974c64 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.053105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.053846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.054241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.054540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.055219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.060850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 765/1531] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.064841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.081107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.102363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 767/1532] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.103173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.112342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e829-fb5b-4d31-95bb-e2b2b85ffe81 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.134401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d15ba-5091-4b80-9390-59f45b348ee3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.139007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.139610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.139896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.140198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.140884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:30.141191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.168088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.176013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.176619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.176918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.177203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.177837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.180258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 766/1533] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:30.181029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.190086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27950730-3b9b-4f37-b976-9f761ac565a1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.194514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.195124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.195418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.195705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.196338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.204006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.222921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.223976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 768/1534] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.224747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.235095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311f7f-26b4-443c-b19d-c9265bf9816c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.239313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.240127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.240425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.241040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] PATH_INFO: `/v3/projects/2f0c4cd55acc4607852747c5d796609e/users/153666ecd9c84936bd1c9ce32373ca27/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.251060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 767/1535] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.251584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.262219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0c4cd55acc4607852747c5d796609e, user_id=153666ecd9c84936bd1c9ce32373ca27, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.290143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.303370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 769/1536] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:30 2022] PUT /identity/v3/projects/2f0c4cd55acc4607852747c5d796609e/users/153666ecd9c84936bd1c9ce32373ca27/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:30.307109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.324884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c8bee-5960-48b7-9e79-925611994928 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.372997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4de23-7731-433a-a8d4-89678b8a9ba6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.377587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.378219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.378626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.378963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.379606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.387649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.388243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.388530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.388809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.389461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.406327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.415201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.433303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 770/1537] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.434439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.443358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 768/1538] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.444490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.505936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71ff62-d377-4532-8c73-2684ccfb8b7b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.510562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.511188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.511474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.511752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.512387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.513721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd18a-ac83-498d-9ca9-63bac63aecb6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.518211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.518856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.519136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.519421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.520116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.538487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.547274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.558841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 769/1539] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:30.559030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 771/1540] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.559843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.562643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.569488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b4959-1c2e-4c42-bb4d-fedc5f4840d3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.572403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec61044-4eed-4d0d-a285-e4229157b57a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.573747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.574326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.574610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.574918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.575611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.577020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.577612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.577905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.578192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.578865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.602038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.605990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84dc2e-a86f-456c-acdd-435e4bcbbf9f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.612329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 772/1541] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:30.612981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.621998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800dab-2cb6-41b6-852c-746c1e84f71a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.626693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.627303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.627589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.627873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.628527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.636519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 770/1542] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/projects => generated 405 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.637647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.637948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.638236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.655160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.659557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:30.660706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:30.677928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 773/1543] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 295 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.677928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.686879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c44e-9c62-4408-9d39-ba6d093686f6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.729251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 771/1544] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:30.729806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.739090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cca1c-c059-4b15-963b-9e15979c3bd8 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.745039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.745649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.745953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.746263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.747061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.755626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.756405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.756764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.757055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.757778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.774922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.783678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.799018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 772/1545] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.799018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.806439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 774/1546] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.806439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.807806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94483610-29f3-40ec-8669-870a681ef829 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.812146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.812968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.813258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.813549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] PATH_INFO: `/v3/projects/08ab2bde6dca4830a67ca00d0223b3a7/users/2246bad06441497e9fd542cc1c84da0a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.813731 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc283ab-b38d-4f8e-b966-c0d2a8db1421 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.818201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.818982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.819366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.819647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.820337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.833752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ab2bde6dca4830a67ca00d0223b3a7, user_id=2246bad06441497e9fd542cc1c84da0a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.845637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.856512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 775/1547] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:30.856512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.861650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.869560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599692ea-455f-4a6a-916a-99e1e1d4f0b6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.875814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 773/1548] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:30 2022] PUT /identity/v3/projects/08ab2bde6dca4830a67ca00d0223b3a7/users/2246bad06441497e9fd542cc1c84da0a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:30.876629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.936730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.937553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.937841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.938122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] PATH_INFO: `/v3/projects/f220e56f42ff493d89bcf7599068e85b/users/06e2b2e2f60c4ce8999abd3621495a63/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.945157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d66950-ba03-40b7-a445-c49e950f9d6f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.950446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.951079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.951366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.951639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.952268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.957964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f220e56f42ff493d89bcf7599068e85b, user_id=06e2b2e2f60c4ce8999abd3621495a63, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:30.977895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.984579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.002080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 776/1549] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:30 2022] PUT /identity/v3/projects/f220e56f42ff493d89bcf7599068e85b/users/06e2b2e2f60c4ce8999abd3621495a63/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.002293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 774/1550] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:31.003087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.003210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.068609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6df8a-d251-42f6-9918-5eba521fa31a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.080192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00740f5d-aeb0-4c3a-abed-de2f2ef4a07b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.085205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.085802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.085923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.086167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.086905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.112636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.123353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.124097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.124212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 777/1551] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:31.124582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.124958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.125069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.135879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.136683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41433d3e-ee4d-43a7-83cf-cc6d12bc7321 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.140920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.141747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.142039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.142322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.143030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.161423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.169943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.171067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 775/1552] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:31.171845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.183864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 778/1553] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:31.184175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f9da7-861c-4d7c-b9e6-afa8b7d40145 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.184281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.186423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.187156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.187442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.188011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.188713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.190912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0487e-4c42-4089-a292-146c8b49b2bb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.195776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.196587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.196881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.197163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] PATH_INFO: `/v3/projects/e31c4875ecac4d34ab808ce47c97de5e/users/813ffcd0f8894c6a8ce3672ba759dc4e/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.217472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31c4875ecac4d34ab808ce47c97de5e, user_id=813ffcd0f8894c6a8ce3672ba759dc4e, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.218405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f076bc-f7b9-490d-8a1b-5c1407550927 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.230016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 776/1554] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:31.231303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5829-c6e2-4ecb-b0e5-c5941d123faa None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.231590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5829-c6e2-4ecb-b0e5-c5941d123faa None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.231873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5829-c6e2-4ecb-b0e5-c5941d123faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.245069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.255399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e87a5829-c6e2-4ecb-b0e5-c5941d123faa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.256612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e87a5829-c6e2-4ecb-b0e5-c5941d123faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.260741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 779/1555] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:31 2022] PUT /identity/v3/projects/e31c4875ecac4d34ab808ce47c97de5e/users/813ffcd0f8894c6a8ce3672ba759dc4e/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.261856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.326716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 777/1556] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:31.326716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.327053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.327053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.343830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fa060-310d-496d-a7db-028a7e2e47fa admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.348517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.349123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.349420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.350650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.351604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.365265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] MFA Rules not processed for user `06e2b2e2f60c4ce8999abd3621495a63`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.366646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.378317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.389896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 780/1557] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:31.390474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.400319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d8eea-d85c-4c63-be73-6e6b77b8af3f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.405377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.406200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.406601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.406808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] PATH_INFO: `/v3/projects/f673f0f0edd74c56a204930e93f143da/users/f7cf97b0aa15496393f1a39d5ef759de/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.433211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f673f0f0edd74c56a204930e93f143da, user_id=f7cf97b0aa15496393f1a39d5ef759de, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.458077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 778/1558] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:31.458728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.463700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.471600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f98b7-5de8-4bc5-af49-bd7a16f6d61f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.477529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.478373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.478682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.478962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] PATH_INFO: `/v3/projects/cbbf5bb7e51d4d2d8594d6d1d3a797a3/users/b68bc45984974d6da1c9151c21dae14c/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.485101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 781/1559] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:31 2022] PUT /identity/v3/projects/f673f0f0edd74c56a204930e93f143da/users/f7cf97b0aa15496393f1a39d5ef759de/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.485101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.502105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbf5bb7e51d4d2d8594d6d1d3a797a3, user_id=b68bc45984974d6da1c9151c21dae14c, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.529518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac067cdc-16e8-4f5e-8f5b-b551c65d6b7c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.543177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 779/1560] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:31 2022] PUT /identity/v3/projects/cbbf5bb7e51d4d2d8594d6d1d3a797a3/users/b68bc45984974d6da1c9151c21dae14c/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.544731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.545157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.545591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.555358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f317d-f24d-48d7-94e6-c23eb48f89f6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.582108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] MFA Rules not processed for user `813ffcd0f8894c6a8ce3672ba759dc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.583485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.634987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.638782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.639290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.639826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] PATH_INFO: `/v3/projects/56421cb13c384f629ad1a777430081a9/users/8952a1d6aa80414e9758c2ec839009c1/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.663057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56421cb13c384f629ad1a777430081a9, user_id=8952a1d6aa80414e9758c2ec839009c1, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.674657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 780/1561] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:31.675615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.676871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.697793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.716175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 782/1562] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:31 2022] PUT /identity/v3/projects/56421cb13c384f629ad1a777430081a9/users/8952a1d6aa80414e9758c2ec839009c1/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.725893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.750969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c77038-28b9-498e-a146-fd3a9552d13e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.806331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0cbab-6ad0-4ca7-bd0b-b543e114fc22 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.809212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.809801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.810217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.810501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.812924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.814837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.815245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.815953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] PATH_INFO: `/v3/projects/08f27aa44a5d4f889e2038b08dfa5634/users/0ddd12717d3f48f8a0b178b7329eb6df/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.820827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.837869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f27aa44a5d4f889e2038b08dfa5634, user_id=0ddd12717d3f48f8a0b178b7329eb6df, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:31.847033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ef8b-ee95-4f98-b698-8260dc20920f service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.857569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 781/1563] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:31.858623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b3de-5cc8-49fe-bda5-c2e5bbe2236a None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.858941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b3de-5cc8-49fe-bda5-c2e5bbe2236a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.859222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b3de-5cc8-49fe-bda5-c2e5bbe2236a None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.860933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 782/1564] 10.222.0.48 () {54 vars in 954 bytes} [Fri Apr 8 02:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:31.861768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.862050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.862385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.870254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f9280-7245-4c80-af34-bd839d345528 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.885085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.886238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.898077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 783/1565] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:31 2022] PUT /identity/v3/projects/08f27aa44a5d4f889e2038b08dfa5634/users/0ddd12717d3f48f8a0b178b7329eb6df/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.898077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a668-75c2-4390-83a4-977943b0118a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.898077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a668-75c2-4390-83a4-977943b0118a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.899084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a668-75c2-4390-83a4-977943b0118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.925900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2da2a668-75c2-4390-83a4-977943b0118a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.927207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2da2a668-75c2-4390-83a4-977943b0118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.965227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 783/1566] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:31.966333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.985825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfa74f-bbc1-40c5-98fe-6f755da462ca None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.000702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.001751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.002423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.004016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.004946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.008716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 784/1567] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.009537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9822-918c-454e-822c-1eaf8f324448 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.010113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9822-918c-454e-822c-1eaf8f324448 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.010495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a9822-918c-454e-822c-1eaf8f324448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.045261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7ba9-3206-47b0-9240-b2b889963969 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.049942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-533a9822-918c-454e-822c-1eaf8f324448 None None] MFA Rules not processed for user `8952a1d6aa80414e9758c2ec839009c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.051143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-533a9822-918c-454e-822c-1eaf8f324448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.082891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 784/1568] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:32.082891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.082891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.082891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.107436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.108829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.133553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 785/1569] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.139807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.139807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.140046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.164595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.165094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.195865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 785/1570] 10.222.0.48 () {58 vars in 1051 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.196569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.248244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 786/1571] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.249269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.261521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceab72d-e7b6-462e-8762-f8b49c30b230 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.265245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.265875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.266171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.266864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.278199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.309622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.322520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 786/1572] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:32.323175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.334263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52159b83-a3ba-4cda-a1d6-75ed5e1a2f68 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.341348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.342480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.342808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413dfc2-6e7e-4978-8709-63f60b1338fd None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.342950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.343191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.343968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.347984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.348799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.349543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.350444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.362378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.379676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.395187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6aa5-ade0-4774-8bdb-6c3351dee707 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.408723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 787/1573] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:32.410168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4c5e-a92a-4a71-9a08-20d9d4cae371 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.413527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 787/1574] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/users => generated 309 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:32.413699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4c5e-a92a-4a71-9a08-20d9d4cae371 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.413699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4c5e-a92a-4a71-9a08-20d9d4cae371 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.413906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.414001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 788/1575] 10.222.0.48 () {54 vars in 954 bytes} [Fri Apr 8 02:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:32.415053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4c5e-a92a-4a71-9a08-20d9d4cae371 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.430566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4c5e-a92a-4a71-9a08-20d9d4cae371 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.435344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.436720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.437595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.438353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.441040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819dc56-c79b-4723-ba1b-c5191f82c28a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.457401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.459470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.460070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.460325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.460674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.489288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.504878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 789/1576] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:32.506052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.524508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cf878-c876-4d90-81af-5284fbebc428 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.534876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.535496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.535792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.536082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.536759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.563633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.594938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.597037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e999f86-b3ab-466f-8c43-69dde96a5976 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.609516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 788/1577] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:32.611570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.611929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.612214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.626994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 790/1578] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:32.631783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.646188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9eb37-eef3-47dc-8504-371fd01abb41 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.649270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.653514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.654825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.655047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.655449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.655891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] PATH_INFO: `/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.676006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 789/1579] 10.222.0.48 () {58 vars in 1051 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.691632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.697159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7245897a76b43339a01ea844316a5cc, user_id=e879e8af4fe54370910d095b4bffe753, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.707131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776752e4-f4ba-4bf2-bec1-b1e4644ec730 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.720400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.721003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.721310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.721577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.729959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.748466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 791/1580] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:32 2022] PUT /identity/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:32.752707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.867831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.921685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3e87-f9f9-4876-9a46-e2a21ebba3d7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.932537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.934978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.936061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.936534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.936743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.939218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:32.958597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 790/1581] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:32.999091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.027999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 792/1582] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:33.029205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.043287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c10a-3bd6-442a-8444-4360f029afdf service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.055988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.056925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.057736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.058389 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] PATH_INFO: `/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.062645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7245897a76b43339a01ea844316a5cc, user_id=e879e8af4fe54370910d095b4bffe753, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:33.095046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.123904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 791/1583] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:33 2022] PUT /identity/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:33.128070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.142223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57b832-bcd0-453f-9f10-b02632850b6c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.254770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.412309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12781f8-3178-42b7-97cf-183e55f8f5c0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.419915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.421950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.422978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.422978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.468381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.468966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.469654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.470036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.470917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:33.507994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944e0ee-8504-4621-ab15-40950eb098da admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.529739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 793/1584] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:33.531721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.532019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.532307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.553486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:33.583686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.587454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] MFA Rules not processed for user `2246bad06441497e9fd542cc1c84da0a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:33.589074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:33.597311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 792/1585] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:33.598257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.610446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ee535-8969-41d5-8254-2adc99e902e2 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.637008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.642655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.643118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.643581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] PATH_INFO: `/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.650162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7245897a76b43339a01ea844316a5cc, user_id=e879e8af4fe54370910d095b4bffe753, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:33.703354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc867ad-6718-456f-aba6-33f6485bd399 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.712854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 794/1586] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:33.714026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.721031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 793/1587] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:33 2022] PUT /identity/v3/projects/b7245897a76b43339a01ea844316a5cc/users/e879e8af4fe54370910d095b4bffe753/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:33.734490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed868-57b6-4e61-b0b7-dff46d517e18 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.734864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed868-57b6-4e61-b0b7-dff46d517e18 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.735112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ed868-57b6-4e61-b0b7-dff46d517e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.749312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cef955-f6e3-47c6-908a-4cf29ee2964b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.766358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5d3ed868-57b6-4e61-b0b7-dff46d517e18 None None] MFA Rules not processed for user `2246bad06441497e9fd542cc1c84da0a`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:33.768674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5d3ed868-57b6-4e61-b0b7-dff46d517e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:33.823754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.824363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.824787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.825083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.896183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 794/1588] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:33.901615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.901615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.901615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.966047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] MFA Rules not processed for user `e879e8af4fe54370910d095b4bffe753`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:33.968148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:34.033548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:34.097012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.133053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 795/1589] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:34.133530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 795/1590] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:34.203011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.206467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.213431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e637-f0bf-4212-a1a7-be80d9a94577 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.217005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933caee-0381-40ff-a21a-785e3c4f52bb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.221059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.221890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.222400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.222917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.231399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.232106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.232402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.232685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.236734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:34.250381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:34.272748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.298856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 796/1591] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:34 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:34.316018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.331922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 796/1592] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:34 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:34.917129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.993227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:35.072457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7602aba-39d5-4cb6-af9b-0ee13f35d597 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:35.076969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:35.077777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.078065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.078647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] PATH_INFO: `/v3/users/8952a1d6aa80414e9758c2ec839009c1` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.079958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8952a1d6aa80414e9758c2ec839009c1)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:35.121209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: WARNING py.warnings [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:35.121209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: warnings.warn(msg) Apr 08 02:44:35.121209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: Apr 08 02:44:35.123138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:35.170762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc4832-e359-43ca-8d8b-30c88960f733 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:35.182275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:35.185434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.186060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.187552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] PATH_INFO: `/v3/users/813ffcd0f8894c6a8ce3672ba759dc4e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.189563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813ffcd0f8894c6a8ce3672ba759dc4e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:35.226895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:35.328322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813ffcd0f8894c6a8ce3672ba759dc4e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.342392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813ffcd0f8894c6a8ce3672ba759dc4e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.343363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813ffcd0f8894c6a8ce3672ba759dc4e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.344118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813ffcd0f8894c6a8ce3672ba759dc4e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.357382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4073a945-dbf9-4cea-81a3-b3fa6f86f616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813ffcd0f8894c6a8ce3672ba759dc4e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.375866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 797/1593] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:34 2022] DELETE /identity/v3/users/813ffcd0f8894c6a8ce3672ba759dc4e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:35.377195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d1b5-3b9a-47ca-b2be-0e32cfccbd4f None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.377483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d1b5-3b9a-47ca-b2be-0e32cfccbd4f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.377769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d1b5-3b9a-47ca-b2be-0e32cfccbd4f None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.384319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 798/1594] 10.222.0.48 () {54 vars in 912 bytes} [Fri Apr 8 02:44:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:35.385745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831442f-5202-49fe-8d11-940184fbcf3d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.385938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831442f-5202-49fe-8d11-940184fbcf3d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.386181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831442f-5202-49fe-8d11-940184fbcf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.415187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5831442f-5202-49fe-8d11-940184fbcf3d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:35.416692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5831442f-5202-49fe-8d11-940184fbcf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:35.422826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8952a1d6aa80414e9758c2ec839009c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.442802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8952a1d6aa80414e9758c2ec839009c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.444652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8952a1d6aa80414e9758c2ec839009c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.445717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8952a1d6aa80414e9758c2ec839009c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.456827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3590ee56-cdda-4da4-9df4-dfd0c725ee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8952a1d6aa80414e9758c2ec839009c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.502284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 797/1595] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:34 2022] DELETE /identity/v3/users/8952a1d6aa80414e9758c2ec839009c1 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:35.502284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.502284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.502284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.508066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 799/1596] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:35.508066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.508066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.508066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.534905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:35.536081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:35.613947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:35.615750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:35.647677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 800/1597] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:35.647677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:35.647677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:35.762092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 798/1598] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Apr 8 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:35.765641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:35.768679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:35.799689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0e5b4-b2d4-412e-8ab9-2a7dfc80bd51 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:35.817398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:35.818161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.819236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.819604 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.822373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a246edb-ffa7-42ac-b416-eddf545503be None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:35.833727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:35.835096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.835713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.838001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.846631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:35.869147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:35.899459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:35.910706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 799/1599] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:35.911884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:35.921493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132728c-6326-4958-83c7-47912be4b1e8 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:35.925402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:35.926225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:35.926777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:35.927260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:35.934179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5090-89a9-4e4b-b70d-20eb930d7ae9 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:35.936875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:35.962951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 801/1600] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:36.007392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120fa0d-d079-47e2-bd92-09269c6d8606 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.032568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 800/1601] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:35 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:37.183907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.184465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.184703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.250701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987f46-0068-4705-863e-c3a6e5288269 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.251674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987f46-0068-4705-863e-c3a6e5288269 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.252342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4987f46-0068-4705-863e-c3a6e5288269 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.257008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 801/1602] 10.222.0.48 () {54 vars in 960 bytes} [Fri Apr 8 02:44:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:44:37.261892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.262409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.262932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.293371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] MFA Rules not processed for user `4068eaf366e54d0e88043780889a0893`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:37.296851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.329835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] MFA Rules not processed for user `0ddd12717d3f48f8a0b178b7329eb6df`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:37.333287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.402193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 802/1603] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:37.410700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.430402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be85c-a0d5-4297-b32f-103eb0ec136a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.437251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.438146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.438545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.438957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.442172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.472326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:37.522423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.536087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 803/1604] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:37.538857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.540532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.547479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 802/1605] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:37.548439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.553780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.557648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a736b83-76e3-4dde-881c-2899fb840b85 service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.562841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.564336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.564841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.565331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] PATH_INFO: `/v3/projects/56421cb13c384f629ad1a777430081a9` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.566916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56421cb13c384f629ad1a777430081a9)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:37.595956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550122f-11db-4a56-90c1-bbf42c3cc811 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.610134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.610980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.611279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.611564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] PATH_INFO: `/v3/projects/e31c4875ecac4d34ab808ce47c97de5e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.615804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.625961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31c4875ecac4d34ab808ce47c97de5e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:37.721959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: WARNING py.warnings [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:37.721959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: warnings.warn(msg) Apr 08 02:44:37.721959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: Apr 08 02:44:37.726696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.745148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56421cb13c384f629ad1a777430081a9', 'request_id': 'req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.776587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56421cb13c384f629ad1a777430081a9', 'request_id': 'req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.821247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56421cb13c384f629ad1a777430081a9', 'request_id': 'req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.835044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31c4875ecac4d34ab808ce47c97de5e', 'request_id': 'req-fc175241-e308-43ff-a3ec-1d5ae2052ebc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.844192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] The token cache is being invalidate because project 56421cb13c384f629ad1a777430081a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:37.845153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.846935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.850242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 804/1606] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:37 2022] DELETE /identity/v3/projects/56421cb13c384f629ad1a777430081a9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:37.851325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.852849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.864705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31c4875ecac4d34ab808ce47c97de5e', 'request_id': 'req-fc175241-e308-43ff-a3ec-1d5ae2052ebc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.894244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31c4875ecac4d34ab808ce47c97de5e', 'request_id': 'req-fc175241-e308-43ff-a3ec-1d5ae2052ebc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.955144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] The token cache is being invalidate because project e31c4875ecac4d34ab808ce47c97de5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:37.955438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.960142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc175241-e308-43ff-a3ec-1d5ae2052ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:37.963797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 803/1607] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:37 2022] DELETE /identity/v3/projects/e31c4875ecac4d34ab808ce47c97de5e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:37.965112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.965410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.965696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.029386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25f2d-9b50-4cb6-970b-a6e53cc5cd5f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.031776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:38.033130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.168052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 804/1608] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:38.169219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.170623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.171528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.172182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.172474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.172754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.173409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:38.224485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.259974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3bf3-08b0-4dc9-9115-29b97c1fd982 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.266291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.267432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.267715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.268055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.269861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.278606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 805/1609] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/projects => generated 405 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:38.278606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.283468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:38.285443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.347148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ebd7-7cf1-4ea9-a6bb-0aa5be719197 service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.362988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 805/1610] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:38.364461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678745-5356-465e-b95b-1c264ed56501 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.364863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678745-5356-465e-b95b-1c264ed56501 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.366054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678745-5356-465e-b95b-1c264ed56501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.378239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85144d-8359-41fe-ae20-ad805c67416f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.392676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.395712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.397508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.397508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] PATH_INFO: `/v3/users/e879e8af4fe54370910d095b4bffe753` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.402754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e879e8af4fe54370910d095b4bffe753)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:38.403401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-03678745-5356-465e-b95b-1c264ed56501 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:38.404614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-03678745-5356-465e-b95b-1c264ed56501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.429351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 806/1611] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:38.429351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03678745-5356-465e-b95b-1c264ed56501 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.430517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-03678745-5356-465e-b95b-1c264ed56501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.456422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03678745-5356-465e-b95b-1c264ed56501 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.469002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.470875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.471172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.472665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.473390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.473812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:38.558818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.619351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e879e8af4fe54370910d095b4bffe753'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.626993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 807/1612] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/users => generated 309 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:38.628529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.633933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e879e8af4fe54370910d095b4bffe753'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.634777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e879e8af4fe54370910d095b4bffe753'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.635834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e879e8af4fe54370910d095b4bffe753'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.653657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d187f-0eaa-4e67-a057-273d6ae91c88 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.655146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e879e8af4fe54370910d095b4bffe753'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.664446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.665839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.666653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.666653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.667359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:38.667666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:38.696087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 806/1613] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:38 2022] DELETE /identity/v3/users/e879e8af4fe54370910d095b4bffe753 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:38.696382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.702428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.739982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.772813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 808/1614] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:38.775737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.779555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.804758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ac3-b623-4834-abab-ed4113f74ec7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.901290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dce4-0177-4ea0-a4e8-787b907f164c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.915349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.915989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.916275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.916559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.920834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.006694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.007188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.007878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.008617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.009771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.010514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.047577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 807/1615] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:39.048612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.062241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814f48-d0b1-4224-a565-89628c0859c1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.070048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.071373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.071773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.072344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] PATH_INFO: `/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.079941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.104248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b732bca8d142c79b03897a2d5d86fe, user_id=7581adda9c40496c8b85139c29e00891, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.149978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 809/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/projects => generated 367 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:39.160463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.167280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.187454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 808/1617] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:39 2022] PUT /identity/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:39.188555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.351633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513e23-5af8-42de-80aa-c571cbf6ac0a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.352610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30244a6e-3007-44fd-9dcc-7ea0bcc89044 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.358299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.358824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.359744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.360234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.360738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.361902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.364704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.365713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.366591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.367653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.392767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.403729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.417640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 809/1618] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:39.419067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 810/1619] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:39 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:39.421289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.424505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.435194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a703c-dca6-4b6f-9640-424567142b5f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.441076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.442265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.442754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.443166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] PATH_INFO: `/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.447041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b732bca8d142c79b03897a2d5d86fe, user_id=7581adda9c40496c8b85139c29e00891, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.452221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e7d8-d512-41d2-b019-7ca4f5c898fb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.458386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.459425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.460319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.461193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.462220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.478686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.490956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 810/1620] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:39 2022] PUT /identity/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:39.494526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.497300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.511468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 811/1621] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:39.515583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.531402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae495-e57d-47cc-a2d3-3d663cbf0a65 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.599142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702462b-9ba7-4bc9-9e42-6fa0c7e55972 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.604460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.605069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.605358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.605638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.606336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.643229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.663016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 811/1622] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:39.666853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.673728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.676454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.676974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.678843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] PATH_INFO: `/v3/projects/c6edecb097f14193ae69d625dd50f96a/users/bf8615213196404eab3354fbae4ce0c7/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.679877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fff0-f24c-446c-98b8-e603149f3a48 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.685813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.686639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.686957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.687673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] PATH_INFO: `/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.689581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b732bca8d142c79b03897a2d5d86fe, user_id=7581adda9c40496c8b85139c29e00891, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.729387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf42b-2cac-4bae-8ec6-d47391496b68 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.746966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6edecb097f14193ae69d625dd50f96a, user_id=bf8615213196404eab3354fbae4ce0c7, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:39.754753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 812/1623] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:39 2022] PUT /identity/v3/projects/61b732bca8d142c79b03897a2d5d86fe/users/7581adda9c40496c8b85139c29e00891/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:39.779217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.813515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 812/1624] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:39 2022] PUT /identity/v3/projects/c6edecb097f14193ae69d625dd50f96a/users/bf8615213196404eab3354fbae4ce0c7/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:39.815265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.815629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.815921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.903626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] MFA Rules not processed for user `bf8615213196404eab3354fbae4ce0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:39.908631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:40.002748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 813/1625] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:39 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:40.004297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.128790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52b2a-b652-4416-a914-2a1a8ca703ca admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.151618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.152518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.152813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.153094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.154080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:40.225583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.316296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 813/1626] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:40 2022] POST /identity/v3/projects => generated 369 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:40.320678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.336213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909d74-d32c-49b9-b54c-4e578ee99c39 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.492629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.493331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.493665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.493800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.494459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:40.550760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.590560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 814/1627] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:40 2022] POST /identity/v3/users => generated 291 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:40.592763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.609760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156e19-9a26-4c65-a2d9-f5129e27cd85 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.626511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.627245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.627583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.627878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.629658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:40.668401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.682911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 814/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:40.687235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.699714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9be6ed-ff65-4b55-a854-2724b2ec640a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.715163 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.716014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.716309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.716597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] PATH_INFO: `/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.749313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.751869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:40.760699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b177a5472bd434490e47bc19b4812fb, user_id=48948aa7415c4443badd4b0ef21ba1f6, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:40.777978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e74af1-a4fb-4448-821c-505d59546b51 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.785106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.786248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.787226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.787723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] PATH_INFO: `/v3/projects/b7245897a76b43339a01ea844316a5cc` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.790437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7245897a76b43339a01ea844316a5cc)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:40.810262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.836276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.837149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 815/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:40 2022] PUT /identity/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:40.841406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.946461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7245897a76b43339a01ea844316a5cc', 'request_id': 'req-7679b9d4-2e4a-4b35-921d-97107c051031'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.956544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7245897a76b43339a01ea844316a5cc', 'request_id': 'req-7679b9d4-2e4a-4b35-921d-97107c051031'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.976403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7245897a76b43339a01ea844316a5cc', 'request_id': 'req-7679b9d4-2e4a-4b35-921d-97107c051031'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.989412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] The token cache is being invalidate because project b7245897a76b43339a01ea844316a5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:40.989702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.990926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7679b9d4-2e4a-4b35-921d-97107c051031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.993803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8c00-7870-474c-ba47-ec2837e9f0d4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.998040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 815/1630] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:40 2022] DELETE /identity/v3/projects/b7245897a76b43339a01ea844316a5cc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:40.999633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aef8ac-12e3-42b5-9a2c-b0e5b0db08f2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.999928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aef8ac-12e3-42b5-9a2c-b0e5b0db08f2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.000390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aef8ac-12e3-42b5-9a2c-b0e5b0db08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.033402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-42aef8ac-12e3-42b5-9a2c-b0e5b0db08f2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:41.034681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-42aef8ac-12e3-42b5-9a2c-b0e5b0db08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:41.119999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 816/1631] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:41.122082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.122730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.123026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.123316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.124033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.128642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.128942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.129352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.159278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:41.161167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:41.172279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.176964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 817/1632] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:41.178273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.188112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606ad5-b3d6-4f5c-8294-c0f1953d08b9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.199849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.201735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 816/1633] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:41.202396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.202750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.203015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.203721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:41.204024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.207214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.211329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:41.237142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ffd02-27c3-4801-8e21-3eb5a9b1bf49 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.250694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.251998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.252291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.252649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] PATH_INFO: `/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.255375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b177a5472bd434490e47bc19b4812fb, user_id=48948aa7415c4443badd4b0ef21ba1f6, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.273330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.300925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 818/1634] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:41.303767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.307131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.320628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 817/1635] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:41 2022] PUT /identity/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:41.323479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb697-6341-422a-8ac9-a1b0cff9782f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.324481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.413151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.413806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.414105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.414388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.415098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.451066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.471366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8ba5e-f1ca-4083-97b9-30c72a7a25fd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.476776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.477126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.477344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.477626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.478561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.494060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 819/1636] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:41 2022] POST /identity/v3/projects => generated 357 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:41.499204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.512560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.548333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 818/1637] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:41.549258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.573366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb98da7-8fc6-4d12-a998-49580dc6d2ea admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.610364 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa3d2-a6ab-4761-ad2d-195522df98ea admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.617126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.617844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.618040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.618337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.619762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.697671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.702593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.706320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.706320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.706320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] PATH_INFO: `/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.720940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b177a5472bd434490e47bc19b4812fb, user_id=48948aa7415c4443badd4b0ef21ba1f6, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.734308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 820/1638] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:41 2022] POST /identity/v3/users => generated 279 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:41.743756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.759756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675426c-56de-4fa0-a39c-82ab0b51fe59 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.773326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.774147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.774292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.774568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.777715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:41.794709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec73b-530b-4e23-893f-105a64acf74b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.834335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 819/1639] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:41 2022] PUT /identity/v3/projects/3b177a5472bd434490e47bc19b4812fb/users/48948aa7415c4443badd4b0ef21ba1f6/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:41.834596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.836354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.836751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.837130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.846092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 821/1640] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:41.850809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.893914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9f32-e216-4aa2-8083-d18de22bf699 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.916544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] MFA Rules not processed for user `48948aa7415c4443badd4b0ef21ba1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:41.919950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:42.042389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:42.042870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.043165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.043451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] PATH_INFO: `/v3/projects/ca50aaf96a0e4bb89ecc45ab4c84f9de/users/4c45ee6fc7de4817a21de21d2f7ddf35/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.097802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 820/1641] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:41 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:42.098036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca50aaf96a0e4bb89ecc45ab4c84f9de, user_id=4c45ee6fc7de4817a21de21d2f7ddf35, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:42.104975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:42.106701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:42.149730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e30af8-5510-4b51-bd9b-0f2574059c73 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:42.183896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 822/1642] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:41 2022] PUT /identity/v3/projects/ca50aaf96a0e4bb89ecc45ab4c84f9de/users/4c45ee6fc7de4817a21de21d2f7ddf35/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:42.197322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.197904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.198944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.242468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f49d3b-3940-49cf-aeb4-81fb49b4e779 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:42.289066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] MFA Rules not processed for user `4c45ee6fc7de4817a21de21d2f7ddf35`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:42.290532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:42.384279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:42.385011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.385730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.385730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.419175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 823/1643] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:42 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:42.423773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:42.571586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:42.612432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8af19-2e24-43f0-8dfe-ca5e576abec2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:42.618202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:42.619041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.619480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.620020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.620937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:42.630034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:42.651534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 821/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:42 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:42.695492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:42.774413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:42.784601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb3f0e-b20c-417d-80d0-924c7e3f9db4 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:42.808121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:42.812891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.813983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.814658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.822182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:42.822750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 824/1645] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:42 2022] POST /identity/v3/projects => generated 355 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:42.823739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.068864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ada18-c751-4cd3-8311-ab0d3d42431e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.076863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:43.088662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.088662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.096736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.097135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.098377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:43.191416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.208790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.216419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 822/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:42 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:43.259076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 825/1647] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:42 2022] POST /identity/v3/users => generated 284 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:43.263257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.308810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b89647-6455-49cd-b008-ff6721e11b09 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.331065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.333138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.333464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.335396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.339544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:43.419926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72526f5-4ca3-498a-93cc-dd7453d80cff admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.449214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 823/1648] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:43.450479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.467309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30246f-a89c-49ff-890c-9871071581ea admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.489710 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.491394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.491977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.492359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] PATH_INFO: `/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.558378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35409ec2890d492fae9b9d574d91cbb9, user_id=d86a87a04756428a985b11c471a2c7bb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:43.579244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.580259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.580931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.647441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.657852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:43.662758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:43.688101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 826/1649] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:43 2022] PUT /identity/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:43.692894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.898041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579563df-031b-4757-a910-45163b31dab6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.903251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.904562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.904562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.904785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.905490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:43.907982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 824/1650] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 08 02:44:43.965717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.978759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 827/1651] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:43.982931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.001132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73233cb4-894c-4f22-91e7-ea1bafeddb3f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.027493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.028672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.029073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.029471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] PATH_INFO: `/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.035611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35409ec2890d492fae9b9d574d91cbb9, user_id=d86a87a04756428a985b11c471a2c7bb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:44.106493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.145158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 825/1652] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:43 2022] PUT /identity/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:44.149499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.172313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8310-f045-41f8-acaf-bb92c9c452bc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.357836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.359660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:44.450169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.454699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.456980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.457353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.462452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:44.562351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.613522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 828/1653] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:44.618755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.650172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d216ef-eb64-4c79-99c9-4ba2b5c8b9b6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.660331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f6404-dcaf-42a7-bf78-cd8516329369 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.667325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.669728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.670606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.680130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] PATH_INFO: `/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.683199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35409ec2890d492fae9b9d574d91cbb9, user_id=d86a87a04756428a985b11c471a2c7bb, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:44.686374 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.687477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.688999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.692684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.816180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527efab-3e85-421c-a057-225b24bcc24b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.864512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 829/1654] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:44 2022] PUT /identity/v3/projects/35409ec2890d492fae9b9d574d91cbb9/users/d86a87a04756428a985b11c471a2c7bb/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:44.878301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.878729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.879088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.992105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:45.088920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:45.097383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] MFA Rules not processed for user `d86a87a04756428a985b11c471a2c7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:45.099075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.135598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 826/1655] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:45.395921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 830/1656] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:44 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:45.408674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.410842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.669251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb11480-2a6d-474a-8867-9299e0fcbd16 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:45.883931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.885377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.899407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:45.900620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.903196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.907619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.940097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:46.075618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d30461-e7ed-473b-9b61-33a7b0ce353e service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:46.153084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769bfb-8d1c-4db5-82e6-048582fe7060 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:46.156058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 827/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:45 2022] GET /identity/v3/auth/tokens => generated 3729 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:46.171552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:46.172385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:46.172953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:46.173248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] PATH_INFO: `/v3/users/06e2b2e2f60c4ce8999abd3621495a63` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:46.174757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e2b2e2f60c4ce8999abd3621495a63)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:46.243295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:46.410137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e2b2e2f60c4ce8999abd3621495a63'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.453080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e2b2e2f60c4ce8999abd3621495a63'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.456045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e2b2e2f60c4ce8999abd3621495a63'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.458082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e2b2e2f60c4ce8999abd3621495a63'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.486734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e2b2e2f60c4ce8999abd3621495a63'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.524199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 831/1658] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:45 2022] DELETE /identity/v3/users/06e2b2e2f60c4ce8999abd3621495a63 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:46.526048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:46.526453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:46.526888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:46.589594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:46.594860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:46.597459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:46.598866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:46.838929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25166451-41d8-4643-aa2c-0c201c680148 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:46.859942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:46.860894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:46.861582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:46.862034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:46.864671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:46.889065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 828/1659] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:47.032549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.034391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.260120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:47.298226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd009e3-b11d-4a58-aca5-24cba1717b92 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:47.317294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:47.318517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.318865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.319367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.359180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:47.395737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a83d1-5e79-490d-bb26-f7e54698d4f3 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.447488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865b199-85bd-4b91-9bc4-5e69c5783888 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.448282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 832/1660] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:46 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:47.488769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 829/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:47.531970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.532694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.533238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.683738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] MFA Rules not processed for user `f7cf97b0aa15496393f1a39d5ef759de`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:47.684958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.752096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353fac-c067-485c-b540-53959a6ea50e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.753059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353fac-c067-485c-b540-53959a6ea50e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.753579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353fac-c067-485c-b540-53959a6ea50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.869262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c9353fac-c067-485c-b540-53959a6ea50e None None] MFA Rules not processed for user `7581adda9c40496c8b85139c29e00891`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:47.870610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c9353fac-c067-485c-b540-53959a6ea50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.973102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 833/1662] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:47.982620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.984251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:48.173843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 830/1663] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:48.226653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb5b14-a926-4864-af58-21cdd36c4891 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.238310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.247277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.247824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.248266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.277222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:48.343442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.355440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 834/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:47 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:50.276356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.277239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.277684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.320981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:50.331450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:50.348215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 831/1665] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Apr 8 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:50.401920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.404495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:50.436719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd9fd4-27e2-4c9b-b637-a813c9b4ba62 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.452051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.452880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.453170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.453625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] PATH_INFO: `/v3/users/bf8615213196404eab3354fbae4ce0c7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.454942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8615213196404eab3354fbae4ce0c7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:50.510886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.561235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.573432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf17f2-af21-4d5c-8482-8ec89331736c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.580722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.581685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.582229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.582773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.603619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:50.668270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedc297-2a20-4f2c-b25e-2401ffcaec4d service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.679357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 832/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:50 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:50.683421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8615213196404eab3354fbae4ce0c7'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:50.702006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8615213196404eab3354fbae4ce0c7'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:50.710170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8615213196404eab3354fbae4ce0c7'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:50.711092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8615213196404eab3354fbae4ce0c7'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:50.722581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8615213196404eab3354fbae4ce0c7'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:50.747852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 835/1667] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:50 2022] DELETE /identity/v3/users/bf8615213196404eab3354fbae4ce0c7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:50.752178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.752480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.752767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.819926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:50.821107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:51.086536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:51.162320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:51.163947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:51.327927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb1f08-3b1c-42a6-8a30-e273e4fc1e84 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:51.333067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:51.333911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.334359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.334835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.346848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:51.402052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:51.433101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 836/1669] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:52.762760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:52.765091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:52.788503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d86d9-5ffe-46e4-bd0d-f9d209b38ae4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:52.804841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:52.805972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:52.806466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:52.806971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] PATH_INFO: `/v3/projects/f220e56f42ff493d89bcf7599068e85b` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:52.808348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f220e56f42ff493d89bcf7599068e85b)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:52.872719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:52.982465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:52.983005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f220e56f42ff493d89bcf7599068e85b', 'request_id': 'req-199f617b-9b04-4685-b176-f1b4f95a9b7e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:52.984001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:52.990880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f220e56f42ff493d89bcf7599068e85b', 'request_id': 'req-199f617b-9b04-4685-b176-f1b4f95a9b7e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.009788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f220e56f42ff493d89bcf7599068e85b', 'request_id': 'req-199f617b-9b04-4685-b176-f1b4f95a9b7e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.020217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dbf67-2db0-42a6-a119-48a3d5433661 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:53.035984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] The token cache is being invalidate because project f220e56f42ff493d89bcf7599068e85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:53.039272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.041719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-199f617b-9b04-4685-b176-f1b4f95a9b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.047134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 834/1670] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:52 2022] DELETE /identity/v3/projects/f220e56f42ff493d89bcf7599068e85b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:53.053420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493dbc-acce-483a-aa57-b514873fd69c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:53.053986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493dbc-acce-483a-aa57-b514873fd69c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:53.054627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493dbc-acce-483a-aa57-b514873fd69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:53.139624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7c493dbc-acce-483a-aa57-b514873fd69c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:53.156649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7c493dbc-acce-483a-aa57-b514873fd69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:53.293895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:53.294730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:53.295022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:53.295302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] PATH_INFO: `/v3/projects/c6edecb097f14193ae69d625dd50f96a` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:53.299448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6edecb097f14193ae69d625dd50f96a)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:53.362350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:53.485409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 835/1671] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:53.487742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:53.488065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:53.488351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:53.497261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6edecb097f14193ae69d625dd50f96a', 'request_id': 'req-9011b573-fc87-45dc-888c-c2f6be0b69f6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.522423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6edecb097f14193ae69d625dd50f96a', 'request_id': 'req-9011b573-fc87-45dc-888c-c2f6be0b69f6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.540372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:53.541933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:53.557593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6edecb097f14193ae69d625dd50f96a', 'request_id': 'req-9011b573-fc87-45dc-888c-c2f6be0b69f6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.600764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] The token cache is being invalidate because project c6edecb097f14193ae69d625dd50f96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:53.601081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.605929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.611001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 837/1672] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:52 2022] DELETE /identity/v3/projects/c6edecb097f14193ae69d625dd50f96a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:53.611907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:53.616491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:53.705330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 836/1673] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:53.705330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:53.706262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:53.732473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcafa6c-b979-48f4-b604-800399e9b5ee None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:53.752638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:53.752638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:53.752638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:53.752638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] PATH_INFO: `/v3/users/48948aa7415c4443badd4b0ef21ba1f6` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:53.753108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48948aa7415c4443badd4b0ef21ba1f6)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:53.799188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011b573-fc87-45dc-888c-c2f6be0b69f6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:53.815392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:53.816666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:53.820451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:53.820906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] PATH_INFO: `/v3/users/0ddd12717d3f48f8a0b178b7329eb6df` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:53.821716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:53.824653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddd12717d3f48f8a0b178b7329eb6df)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:53.893391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:53.957371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48948aa7415c4443badd4b0ef21ba1f6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.981143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48948aa7415c4443badd4b0ef21ba1f6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.983069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48948aa7415c4443badd4b0ef21ba1f6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:53.984171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48948aa7415c4443badd4b0ef21ba1f6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.003456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48948aa7415c4443badd4b0ef21ba1f6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.040043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddd12717d3f48f8a0b178b7329eb6df'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.051178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 837/1674] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:53 2022] DELETE /identity/v3/users/48948aa7415c4443badd4b0ef21ba1f6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:54.052322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:54.058312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:54.073489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddd12717d3f48f8a0b178b7329eb6df'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.077126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddd12717d3f48f8a0b178b7329eb6df'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.079073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddd12717d3f48f8a0b178b7329eb6df'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.112543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddd12717d3f48f8a0b178b7329eb6df'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:54.155123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 838/1675] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:53 2022] DELETE /identity/v3/users/0ddd12717d3f48f8a0b178b7329eb6df => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:54.249920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a124cb-fd39-47e5-bc2c-9ec157e11d03 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:54.429624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:54.430489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:54.430947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:54.431373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:54.432220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:54.432687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:54.488804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:54.512084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 838/1676] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:54.513301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:54.514769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:54.560106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ce37-8bbe-4310-8418-c99da0c7f40c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:54.590499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:54.591153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:54.591441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:54.592745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:54.593373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:54.677702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:54.837545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:54.839625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 839/1677] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:54 2022] POST /identity/v3/projects => generated 371 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:54.854267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa52b7-9181-4b23-a92f-56ca31159152 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:55.090770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:55.091726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.093478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.094009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.102427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:55.185325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:55.256736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 839/1678] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:54 2022] POST /identity/v3/users => generated 286 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:55.257797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:55.270423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dde9b-0ade-4ac1-9ba5-e8e1ba0a65cb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:55.284626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:55.285524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.286060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.287182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.288095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:55.345426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf675f0-01a7-42ef-aa2c-7a0ab9e5c883 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:55.372292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 840/1679] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:55.378624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:55.397533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4928-f617-462e-9189-8886d33b8dce admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:55.414456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:55.416203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.417267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.417267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] PATH_INFO: `/v3/projects/4c542958697f42c2b41deb789f7fdd28/users/9b71c0ec139a4de0bf0241f381e8bb8a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.466463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c542958697f42c2b41deb789f7fdd28, user_id=9b71c0ec139a4de0bf0241f381e8bb8a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:55.538691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615d04-d7d1-45c7-80d0-0148996143eb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:55.577612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 840/1680] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:55 2022] PUT /identity/v3/projects/4c542958697f42c2b41deb789f7fdd28/users/9b71c0ec139a4de0bf0241f381e8bb8a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:55.580993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.581333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.581637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.740694 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] MFA Rules not processed for user `9b71c0ec139a4de0bf0241f381e8bb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:55.742014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:55.829468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc535-6dc6-463a-b2b3-25ea7a401e49 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.829763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc535-6dc6-463a-b2b3-25ea7a401e49 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.830050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dc535-6dc6-463a-b2b3-25ea7a401e49 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.832423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 841/1681] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:44:55.857000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:55.857670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:55.857670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:55.935007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:55.937548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:56.002772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 841/1682] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:55 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:56.003934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:56.007641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:56.238396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97358e8-20e2-467f-846e-80016a8660fb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:56.243518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 842/1683] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:44:55 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:56.244474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:56.244996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:56.245903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:56.246304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:56.246886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] PATH_INFO: `/v3/projects/08f27aa44a5d4f889e2038b08dfa5634` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:56.247956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:56.248347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f27aa44a5d4f889e2038b08dfa5634)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:56.279646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:56.289621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298461b6-b3a0-45bf-8b55-47a4da42baff None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:56.321983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:56.323445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:56.327851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:56.328487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:56.350338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:56.370520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f27aa44a5d4f889e2038b08dfa5634', 'request_id': 'req-58b0926b-987d-4d44-9daa-500571ef8148'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.389853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f27aa44a5d4f889e2038b08dfa5634', 'request_id': 'req-58b0926b-987d-4d44-9daa-500571ef8148'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.408165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f27aa44a5d4f889e2038b08dfa5634', 'request_id': 'req-58b0926b-987d-4d44-9daa-500571ef8148'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.415478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:56.425817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] The token cache is being invalidate because project 08f27aa44a5d4f889e2038b08dfa5634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:56.426494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.428232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.430219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 842/1684] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:56 2022] DELETE /identity/v3/projects/08f27aa44a5d4f889e2038b08dfa5634 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:56.435042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:56.437283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:56.442733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 843/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:56 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:56.589618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0926b-987d-4d44-9daa-500571ef8148 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:56.598962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:56.600249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:56.601006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:56.601654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] PATH_INFO: `/v3/users/7581adda9c40496c8b85139c29e00891` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:56.604474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7581adda9c40496c8b85139c29e00891)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:56.715053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:56.812902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:56.814693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:56.871351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7581adda9c40496c8b85139c29e00891'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.891024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31d295-97cb-4277-9578-8c6d38385f2c service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:56.907334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7581adda9c40496c8b85139c29e00891'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.911100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7581adda9c40496c8b85139c29e00891'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.916336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7581adda9c40496c8b85139c29e00891'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.947817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7581adda9c40496c8b85139c29e00891'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:56.979815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 843/1686] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:56 2022] DELETE /identity/v3/users/7581adda9c40496c8b85139c29e00891 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:56.979815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:56.990549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:57.197293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47178f6f-ea85-46b9-8e49-719c4e4958d9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:57.207321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:57.208808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:57.209231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:57.209673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] PATH_INFO: `/v3/projects/3b177a5472bd434490e47bc19b4812fb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:57.212048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b177a5472bd434490e47bc19b4812fb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:57.229845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:57.235383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:57.235728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:57.236024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:57.246004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:57.258947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:57.298894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:57.331387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1f83a-9496-4463-b811-e049305c49ce service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:57.346304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 844/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:56 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:57.389303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b177a5472bd434490e47bc19b4812fb', 'request_id': 'req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:57.406190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b177a5472bd434490e47bc19b4812fb', 'request_id': 'req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:57.436507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b177a5472bd434490e47bc19b4812fb', 'request_id': 'req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:57.470185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] The token cache is being invalidate because project 3b177a5472bd434490e47bc19b4812fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:57.470525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:57.472474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2b57d4ba-feb3-42bf-aec3-850e6c0ea136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:57.478785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 844/1688] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:56 2022] DELETE /identity/v3/projects/3b177a5472bd434490e47bc19b4812fb => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:57.481703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:57.482309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:57.482916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:57.537983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:57.541988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:57.980725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 845/1689] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:57.981874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:57.982184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:57.982581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.052561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:58.054090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:58.081295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 845/1690] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:58.086037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:58.095796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb6c7-b833-472e-9888-14e975cb22e7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:58.125096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:58.125724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.126019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.126302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.127045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:44:58.127346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:58.253983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:58.284970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 846/1691] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:58.285785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:58.297229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988388b-f426-4ca4-9397-38a914cccc5d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:58.328049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:58.328663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.328953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.329235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.329880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:58.396475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0838-fb86-45c8-9a0a-0d43f93ae8c1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:58.472572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 846/1692] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:58 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:58.483379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:58.508435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34af41-0fcd-4127-bb69-afd0018375e1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:58.657441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616b49-aa05-43d3-8510-d5a498c00b9a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.657756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616b49-aa05-43d3-8510-d5a498c00b9a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.658027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616b49-aa05-43d3-8510-d5a498c00b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.664365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:58.664365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.664365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.664365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.665052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:58.718440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8d616b49-aa05-43d3-8510-d5a498c00b9a None None] MFA Rules not processed for user `153666ecd9c84936bd1c9ce32373ca27`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:58.718440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8d616b49-aa05-43d3-8510-d5a498c00b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:58.796666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:58.868986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 847/1693] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:58.870641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.870972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.871265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.893023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 847/1694] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:58 2022] POST /identity/v3/users => generated 294 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:58.897354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:58.914189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] MFA Rules not processed for user `153666ecd9c84936bd1c9ce32373ca27`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:58.915504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:58.922693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 848/1695] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:58.935345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:58.940651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:58.944397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fa328-6d5d-4eed-93f9-64d9957083ea admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:58.962475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:58.963155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:58.963449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:58.963734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:58.965442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:59.083202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:59.131336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 848/1696] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:59.135825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:59.168488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36705853-7dd6-49e0-a580-c7fc29082146 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:59.183140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:59.185261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.186418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.187625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] PATH_INFO: `/v3/projects/a680a454125741bbade5c40bf0a4f1af/users/449ca21962a24231ab823352e2cc3acb/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.218503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb167-1b16-4ac6-ad05-440163f04849 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:59.222644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a680a454125741bbade5c40bf0a4f1af, user_id=449ca21962a24231ab823352e2cc3acb, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:59.226442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:59.227391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.227956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.228656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.246430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:59.264815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:59.282855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24d1f-760d-470e-ac20-732a6d3bff04 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:59.289438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 849/1697] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:59 2022] PUT /identity/v3/projects/a680a454125741bbade5c40bf0a4f1af/users/449ca21962a24231ab823352e2cc3acb/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:59.290921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:59.293806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:59.295822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 849/1698] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:58 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:59.299293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.302912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.303472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.418585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] MFA Rules not processed for user `449ca21962a24231ab823352e2cc3acb`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:59.420039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:59.494415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0366-3058-48e3-807a-88c13e5d8caf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:59.503752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:59.504586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.504952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.505945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] PATH_INFO: `/v3/projects/61b732bca8d142c79b03897a2d5d86fe` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.508002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b732bca8d142c79b03897a2d5d86fe)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:59.544544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:59.571264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 850/1699] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:59.576043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:59.595510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982b261-5514-4f39-8238-59ac1adfcbbb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:59.606983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:59.608211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.608464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.608753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.609889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:44:59.655411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b732bca8d142c79b03897a2d5d86fe', 'request_id': 'req-da53396a-80e4-4058-9336-5b324a9b1c51'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:59.666478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b732bca8d142c79b03897a2d5d86fe', 'request_id': 'req-da53396a-80e4-4058-9336-5b324a9b1c51'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:59.676064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:59.694221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b732bca8d142c79b03897a2d5d86fe', 'request_id': 'req-da53396a-80e4-4058-9336-5b324a9b1c51'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:59.716222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] The token cache is being invalidate because project 61b732bca8d142c79b03897a2d5d86fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:59.716634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:59.717623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-da53396a-80e4-4058-9336-5b324a9b1c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:59.719614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 850/1700] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:59 2022] DELETE /identity/v3/projects/61b732bca8d142c79b03897a2d5d86fe => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:59.726306 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342d13-13dc-4d3b-9171-b22135827533 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.728448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342d13-13dc-4d3b-9171-b22135827533 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.728953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342d13-13dc-4d3b-9171-b22135827533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.744282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 851/1701] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:59.747707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:59.752015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:59.770354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b5342d13-13dc-4d3b-9171-b22135827533 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:59.772263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b5342d13-13dc-4d3b-9171-b22135827533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:59.850802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 851/1702] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:59.852381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2815179-f33a-4c2f-87b5-cd0d542f3ee4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.852794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2815179-f33a-4c2f-87b5-cd0d542f3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.853185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2815179-f33a-4c2f-87b5-cd0d542f3ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.897614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e2815179-f33a-4c2f-87b5-cd0d542f3ee4 None None] MFA Rules not processed for user `f7cf97b0aa15496393f1a39d5ef759de`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:59.898965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e2815179-f33a-4c2f-87b5-cd0d542f3ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:59.972886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 852/1703] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:59.975536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:59.976001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:59.976535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:59.986609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871fda4-69b5-4724-96f4-62a3f91c91d0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.003772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:00.005398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:00.018368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 853/1704] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:00.019567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.027004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.027730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.028028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.028363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.029705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357a3e8-6289-4623-91b7-821aa6bb70a5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.029859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.034967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.035646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.036018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.036868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.037645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:00.038011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.065070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.081439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 854/1705] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:00.085965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.096038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b96c8-459b-489d-adf8-6e5fc38738e5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.101281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.101705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.102449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.102881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.103269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.104022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.136789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.144309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 852/1706] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:59 2022] POST /identity/v3/users => generated 300 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:00.149639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.181635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7abec-931c-4ffa-8cab-dcbdf1fdd6d1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.187181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 855/1707] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:00 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:00.188507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.327335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.329073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.329511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.329944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.331010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.402554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968f917-a09e-4446-9ed0-048cbadb4d9f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.408081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.408724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.409116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.409507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.410237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.414293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.441334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 853/1708] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:00.452323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0eec8-5807-408c-92e5-29dd8c91225f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.452692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.475848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca81dd-378c-4df1-b751-a83606ea4905 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.488638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.490087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.490434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.490777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] PATH_INFO: `/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.493617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 856/1709] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:00 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:00.495164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf977cf-91f6-4b69-9043-71cfc1f9c600 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.495523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf977cf-91f6-4b69-9043-71cfc1f9c600 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.495809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf977cf-91f6-4b69-9043-71cfc1f9c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.544315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a6da0424eb4d518396d3da483e15cb, user_id=bb92f94338b945a992523ca7fe13a2cb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.549031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ddf977cf-91f6-4b69-9043-71cfc1f9c600 None None] MFA Rules not processed for user `b68bc45984974d6da1c9151c21dae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:00.550219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ddf977cf-91f6-4b69-9043-71cfc1f9c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:00.591489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.610595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 854/1710] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:00 2022] PUT /identity/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:00.612041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.644739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 857/1711] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:00 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:00.646594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7786fe-4c93-4c5e-b62f-2fdc8e5d81f6 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.647127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7786fe-4c93-4c5e-b62f-2fdc8e5d81f6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.647635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7786fe-4c93-4c5e-b62f-2fdc8e5d81f6 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.649849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 858/1712] 10.222.0.48 () {54 vars in 912 bytes} [Fri Apr 8 02:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:45:00.650836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7786fe-4c93-4c5e-b62f-2fdc8e5d81f6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.761001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cd87f-55ba-4825-9a6e-f85724418151 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.764829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7786fe-4c93-4c5e-b62f-2fdc8e5d81f6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.770205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.771162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.771616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.772046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.772375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.773243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.773724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.774970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.775430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.777280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.809742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f36fc5-1649-4e50-9af2-26a203035c32 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.817195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.822274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 859/1713] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:00.827012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.827380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.827754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.838303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 855/1714] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:00.854261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.857267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:00.858656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:00.866063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c091122-63f5-4360-9aab-3ff1fa228cd4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:00.871320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:00.872269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:00.873078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:00.873445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] PATH_INFO: `/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:00.876047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a6da0424eb4d518396d3da483e15cb, user_id=bb92f94338b945a992523ca7fe13a2cb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:00.906608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:00.920726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 856/1715] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:00 2022] PUT /identity/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:00.923741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.953482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 860/1716] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Apr 8 02:45:00 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:00.955101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:00.978048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7068f3-c8ad-4864-b591-182018204361 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.096321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae5e14-338c-44fc-b2db-ffca32e8a70d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.107142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.107988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.108283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.108569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] PATH_INFO: `/v3/projects/ed5f7fee483a450284b4df5d40276682/users/e7b00cf140e24432ba791f820104cf6c/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.131527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.132034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.132270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.132558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.133279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:01.147212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5f7fee483a450284b4df5d40276682, user_id=e7b00cf140e24432ba791f820104cf6c, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:01.186677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:01.206975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:01.221073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 861/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:01.222130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:01.241219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:01.245177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 857/1718] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:00 2022] PUT /identity/v3/projects/ed5f7fee483a450284b4df5d40276682/users/e7b00cf140e24432ba791f820104cf6c/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:01.258013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:01.392787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fff3b2-2483-4d02-b575-cd7f420aef39 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.401914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252458a-c468-4d8b-871c-651674622dfe admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.406336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.407532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.408006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.408466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] PATH_INFO: `/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.412173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a6da0424eb4d518396d3da483e15cb, user_id=bb92f94338b945a992523ca7fe13a2cb, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:01.501975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8142a7-a5c7-496c-b5d5-09b0b8575505 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:01.520120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 858/1719] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:01 2022] PUT /identity/v3/projects/b7a6da0424eb4d518396d3da483e15cb/users/bb92f94338b945a992523ca7fe13a2cb/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:01.523331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160187-4eeb-4947-9929-95efece2ceca None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.524512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160187-4eeb-4947-9929-95efece2ceca None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.525007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160187-4eeb-4947-9929-95efece2ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.564994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.565596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.565892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.566221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.572554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-87160187-4eeb-4947-9929-95efece2ceca None None] MFA Rules not processed for user `e7b00cf140e24432ba791f820104cf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:01.574302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-87160187-4eeb-4947-9929-95efece2ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:01.582450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:01.672871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:01.675079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 859/1720] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:01.677735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.678150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.678531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.707069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 862/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:01 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:01.710027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:01.735240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] MFA Rules not processed for user `bb92f94338b945a992523ca7fe13a2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:01.736595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:01.776626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440074b-ba24-4403-995d-971307dc6979 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.845248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 860/1722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:01.846148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:01.847460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:01.950392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39478dfe-27ea-47b2-bc2b-df0e003ceaef None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:01.962833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.963664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.964008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.964672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] PATH_INFO: `/v3/users/9b71c0ec139a4de0bf0241f381e8bb8a` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.970782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b71c0ec139a4de0bf0241f381e8bb8a)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:01.986121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:01.987422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:01.987984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:01.988314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:01.989062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:02.022288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.034191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.070723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 863/1723] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:01 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:02.071397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.074808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.145015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b71c0ec139a4de0bf0241f381e8bb8a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:02.178082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b71c0ec139a4de0bf0241f381e8bb8a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:02.179264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b71c0ec139a4de0bf0241f381e8bb8a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:02.180102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b71c0ec139a4de0bf0241f381e8bb8a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:02.189987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b71c0ec139a4de0bf0241f381e8bb8a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:02.207081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 861/1724] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:01 2022] DELETE /identity/v3/users/9b71c0ec139a4de0bf0241f381e8bb8a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:02.208561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.210487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.289115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a22c38-56c3-4c7b-90cc-db59e2487e82 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.390240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6e300-f997-4f4f-9280-8e20a69e58e8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.405996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.406626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.407409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.407548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.407662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.407755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.408021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.408194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:02.408416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.410245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.464985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d45e2-849c-4240-9067-fbf4da153dcd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.502754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:02.512780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 862/1725] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:02 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:02.512780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.512780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.512780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.541656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.559647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 864/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:02 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:02.562462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:02.563488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.566523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.585100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 863/1727] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:02.596353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120e4d7-215c-47c6-9f9d-2e51ea6fb894 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.598441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.600308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.607386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.608013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.608344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.608580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.612635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:02.687219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.702631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 865/1728] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:02.702631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.702631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.718959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada0b97-083f-48bb-9b9c-427da3f0ba73 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.734109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.734981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.735281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.735571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.758715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:02.823882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:02.850001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 864/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:02.850683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:02.886657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9430c-5c80-400e-a83b-931f76a8f344 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.902915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e0ef9-ded0-47c8-a362-e2832b92304d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:02.907754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.911623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.911936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.914586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] PATH_INFO: `/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.918504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:02.924099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:02.928150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:02.929172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:02.932605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:02.993040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e30635bda54c79aba77e387029b8a5, user_id=51cd051292724b27a701ff9df997c078, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:03.119733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:03.149348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 865/1730] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:02 2022] PUT /identity/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:03.158702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:03.185554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:03.290797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:03.315775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 866/1731] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:02 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:03.344829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243588c-98ca-4283-9646-9da21b0da79a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:03.352798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:03.356818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:03.357139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:03.357434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:03.366191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:03.508896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:03.551299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:03.564692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 866/1732] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:03.569859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16851b-2ffa-46e6-944c-90371f919a89 service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:03.589810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:03.590696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:03.590988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:03.594034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] PATH_INFO: `/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:03.602489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e30635bda54c79aba77e387029b8a5, user_id=51cd051292724b27a701ff9df997c078, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:03.725224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2611f-8106-4204-ad03-e690b24598db admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:03.753515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:03.753907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 867/1733] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:03 2022] PUT /identity/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:03.766498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e78f8-815f-478c-8a1f-5366e19a642a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:03.900794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26fe0-798e-4d48-a036-ac82d9499996 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:03.901217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26fe0-798e-4d48-a036-ac82d9499996 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:03.901450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26fe0-798e-4d48-a036-ac82d9499996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:03.979542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-eaa26fe0-798e-4d48-a036-ac82d9499996 None None] MFA Rules not processed for user `153666ecd9c84936bd1c9ce32373ca27`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:03.980988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-eaa26fe0-798e-4d48-a036-ac82d9499996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:04.034335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:04.035143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:04.035531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:04.035915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:04.042133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:04.124569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:04.164586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 867/1734] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:04.167494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:04.201182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbfb5e-2f01-44dc-8d00-509d991f0776 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:04.209197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 868/1735] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:03 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:04.226038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:04.227712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:04.228003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:04.228283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] PATH_INFO: `/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:04.237861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e30635bda54c79aba77e387029b8a5, user_id=51cd051292724b27a701ff9df997c078, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:04.290428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:04.337245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 868/1736] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:04 2022] PUT /identity/v3/projects/20e30635bda54c79aba77e387029b8a5/users/51cd051292724b27a701ff9df997c078/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:04.351196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:04.352279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:04.352787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:04.431883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] MFA Rules not processed for user `51cd051292724b27a701ff9df997c078`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:04.433961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:04.672319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:04.674725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:04.690211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 869/1737] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:04 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:04.701266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:04.702827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:04.879021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40481fa-c00f-4096-a4a7-010479062824 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:04.885131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:04.886209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:04.886743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:04.887219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] PATH_INFO: `/v3/projects/4c542958697f42c2b41deb789f7fdd28` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:04.888722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c542958697f42c2b41deb789f7fdd28)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:04.916603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:04.932681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5fc5-0ca9-459c-8c42-dcba2e3e7bdb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:04.956117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:04.957477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:04.961207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:04.961818 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:04.996181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:05.043218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c542958697f42c2b41deb789f7fdd28', 'request_id': 'req-fddc7571-2b9c-4bd1-b775-8ada6081278d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:05.068181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c542958697f42c2b41deb789f7fdd28', 'request_id': 'req-fddc7571-2b9c-4bd1-b775-8ada6081278d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:05.116983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c542958697f42c2b41deb789f7fdd28', 'request_id': 'req-fddc7571-2b9c-4bd1-b775-8ada6081278d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:05.122789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e5f04-0810-4e92-b816-b2b854a6c2b3 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:05.159879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] The token cache is being invalidate because project 4c542958697f42c2b41deb789f7fdd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:05.162028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 870/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:04 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:05.162367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:05.163929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fddc7571-2b9c-4bd1-b775-8ada6081278d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:05.168528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 869/1739] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:04 2022] DELETE /identity/v3/projects/4c542958697f42c2b41deb789f7fdd28 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:05.173443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.173786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.174080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.234920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:05.236879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:05.441708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 871/1740] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:05.450092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.450702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.451092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.488539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:05.490869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:05.630919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:05.632645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:05.642156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 870/1741] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:05.648799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:05.664947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2aa74-3f3e-4dc2-82a4-83b7b640d42c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:05.670106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab99392-f857-4731-afe9-a89a3af4b491 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:05.673640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:05.674355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.676842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.676842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.679154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:05.682324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:05.683652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.685004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.685511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.686425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:05.687182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:05.751351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:05.780551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 871/1742] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:05.782086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:05.792053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:05.816648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df6df9-e995-4350-87ee-11a988d32bf7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:05.832562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:05.834310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.835031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.835532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] PATH_INFO: `/v3/users/449ca21962a24231ab823352e2cc3acb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.839104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] RBAC: Authorizing `identity:delete_user(user_id=449ca21962a24231ab823352e2cc3acb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:05.849268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:05.900070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:05.904979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:05.940970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 872/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:05 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:05.943023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:05.973192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da54d1-61eb-42b9-97bf-aa84f54857c3 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:05.985555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:05.986713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:05.987349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:05.987899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:05.988864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:06.027448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449ca21962a24231ab823352e2cc3acb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:06.060087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449ca21962a24231ab823352e2cc3acb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:06.061854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449ca21962a24231ab823352e2cc3acb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:06.064961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449ca21962a24231ab823352e2cc3acb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:06.079760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:06.086846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-969f0b97-428d-40f2-9a13-45fc0da502af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449ca21962a24231ab823352e2cc3acb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:06.130042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 873/1744] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:05 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:06.132431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 872/1745] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:05 2022] DELETE /identity/v3/users/449ca21962a24231ab823352e2cc3acb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:06.137372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.137897 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:06.139310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.139808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.146298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:06.199667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:06.203117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:06.361310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 873/1746] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:06.393004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:06.394403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:06.491536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49a87c-0db8-43cd-ab8d-4d8bc01b6f8e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:06.491753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51da3-bee8-4f23-b835-d71b4c4dc362 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:06.496665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:06.497764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.498237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.498737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.509740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:06.510364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.510655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.510952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.517584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:06.517980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:06.547022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:06.558238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 874/1747] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:06.597259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:06.622407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 874/1748] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:06 2022] POST /identity/v3/users => generated 282 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:06.627815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:06.639526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510c66a-d55c-4fb4-82cb-70f1bb332a70 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:06.649580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:06.650450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.650975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.651497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.652540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:06.712783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be69134-ffee-4302-9535-0c251fbef963 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:06.730596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 875/1749] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:06.735480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:06.749062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e8c1-e92c-47f5-a05c-cf472d6b922b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:06.755214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:06.756866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.757167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.757845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] PATH_INFO: `/v3/projects/fca9f5cfaba248a88149e8cf6aedca41/users/b54b82bed77a4ee6867f53b9fddfa56e/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.788578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca9f5cfaba248a88149e8cf6aedca41, user_id=b54b82bed77a4ee6867f53b9fddfa56e, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:06.816256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:06.832842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 875/1750] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:06 2022] PUT /identity/v3/projects/fca9f5cfaba248a88149e8cf6aedca41/users/b54b82bed77a4ee6867f53b9fddfa56e/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:06.844759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:06.845422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:06.845808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:06.909854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] MFA Rules not processed for user `b54b82bed77a4ee6867f53b9fddfa56e`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:06.913085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:07.064091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 876/1751] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:06 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:07.065890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:07.235989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371bb70-f600-4590-a455-0748ccf866bc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:07.241142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:07.241754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:07.242132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:07.242532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:07.243323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:07.272702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:07.306459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 876/1752] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:07 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:07.311787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:07.328444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4d25c-8be4-4f79-af7b-9de2f0793c62 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:07.465754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:07.466818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:07.467524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:07.468039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:07.468946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:07.502587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:07.535739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 877/1753] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:07 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:07.541042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:07.555542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d37a2-898d-4b23-81d8-d0615c0a7db9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:07.567464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:07.570452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:07.571407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:07.573057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:07.573552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:07.643337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:07.675356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 877/1754] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:07.680634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:07.694827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296cf9-6843-43e2-bf4a-51eadeef3878 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:07.709917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:07.711015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:07.711431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:07.712144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] PATH_INFO: `/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:07.775378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] RBAC: Authorizing `identity:create_grant(project_id=527894605a574289861aecf9ea2fabfb, user_id=b1167774f1fd472caba46bf51786daf5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:07.854208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:07.883265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 878/1755] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:07 2022] PUT /identity/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:07.884466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:07.897621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17bf51-451c-4801-8233-b550df81799a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:08.041276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:08.042090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:08.042468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:08.042829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:08.062934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:08.165926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:08.201583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 878/1756] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:08.205897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:08.220908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696317f-664e-4d62-a207-b4551b4e282c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:08.235354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:08.236202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:08.236496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:08.236829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] PATH_INFO: `/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:08.242009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=527894605a574289861aecf9ea2fabfb, user_id=b1167774f1fd472caba46bf51786daf5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:08.303054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:08.332197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:08.342758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 879/1757] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:08 2022] PUT /identity/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:08.345955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5901-2c5f-4f20-9303-d35d99e40c4e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:08.368321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:08.370006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:08.552049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d456-ac4c-4be6-a44c-2e2c6b2487bc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:08.557093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:08.558444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:08.559007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:08.559652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] PATH_INFO: `/v3/projects/a680a454125741bbade5c40bf0a4f1af` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:08.561182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a680a454125741bbade5c40bf0a4f1af)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:08.610139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:08.619124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:08.619859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:08.620221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:08.620591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:08.621486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:08.715970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a680a454125741bbade5c40bf0a4f1af', 'request_id': 'req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:08.725270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:08.732202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a680a454125741bbade5c40bf0a4f1af', 'request_id': 'req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:08.756678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 879/1758] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:08.761709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:08.784485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a680a454125741bbade5c40bf0a4f1af', 'request_id': 'req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:08.786203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ce2f-d1bd-43d2-a4b7-00fa2f77f078 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:08.822366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] The token cache is being invalidate because project a680a454125741bbade5c40bf0a4f1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:08.825406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:08.826096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:08.829450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 880/1759] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:08 2022] DELETE /identity/v3/projects/a680a454125741bbade5c40bf0a4f1af => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:08.832513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:08.838887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:09.032233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11ed1b-8a0d-47a0-8bb9-85e0f78ca0ef admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:09.042814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:09.043004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:09.043662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.043952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.044114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.044213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] PATH_INFO: `/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.044558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.044933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] PATH_INFO: `/v3/users/bb92f94338b945a992523ca7fe13a2cb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.046162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb92f94338b945a992523ca7fe13a2cb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:09.053120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527894605a574289861aecf9ea2fabfb, user_id=b1167774f1fd472caba46bf51786daf5, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:09.115409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4071f-2a82-48a2-814b-94d5ada1f502 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:09.125800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:09.158783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 880/1760] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:08 2022] PUT /identity/v3/projects/527894605a574289861aecf9ea2fabfb/users/b1167774f1fd472caba46bf51786daf5/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:09.160288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144369-e835-4dd9-9bfc-a7ed73a6722c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.164049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144369-e835-4dd9-9bfc-a7ed73a6722c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.166046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144369-e835-4dd9-9bfc-a7ed73a6722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.248552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb92f94338b945a992523ca7fe13a2cb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:09.266728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a1144369-e835-4dd9-9bfc-a7ed73a6722c None None] MFA Rules not processed for user `b1167774f1fd472caba46bf51786daf5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:09.269164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a1144369-e835-4dd9-9bfc-a7ed73a6722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:09.269383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb92f94338b945a992523ca7fe13a2cb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:09.275126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb92f94338b945a992523ca7fe13a2cb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:09.275928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb92f94338b945a992523ca7fe13a2cb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:09.290442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb92f94338b945a992523ca7fe13a2cb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:09.317191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 881/1761] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:08 2022] DELETE /identity/v3/users/bb92f94338b945a992523ca7fe13a2cb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:09.371942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 881/1762] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:09.383499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:09.386268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:09.413355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685ddb-d6f9-4fae-82d9-fb4e856e6a85 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.414122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685ddb-d6f9-4fae-82d9-fb4e856e6a85 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.414627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685ddb-d6f9-4fae-82d9-fb4e856e6a85 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.417712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 882/1763] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:45:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:45:09.483038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.483272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.483560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.521289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0bdb1-de4f-404e-a372-4e0aa20c6081 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:09.530658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:09.531510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.533154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:09.533562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.533924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.537438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:09.638397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 883/1764] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:09.644861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:09.649065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:09.667052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b4711-8abb-4b44-8e1f-cd78d50130d7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:09.674022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:09.674851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.675235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.675618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.691259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:09.708703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:09.734775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:09.743611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:09.748134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 882/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:09 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:09.769987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 884/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:09 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:09.899677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:09.913596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674d1-1608-49ab-ac94-58c329d981a0 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:09.921435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:09.923255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:09.925005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:09.925389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:09.933003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:10.169472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:10.219678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d0307-ffa1-45aa-a8ca-be0baa14b51f service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:10.237557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 883/1767] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:09 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:10.863140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:10.865826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:10.962893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbe6e1-219c-4dde-9dcd-fe65f3e56380 service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:10.967583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:10.968428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:10.968719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:10.969054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] PATH_INFO: `/v3/users/4c45ee6fc7de4817a21de21d2f7ddf35` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:10.970449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c45ee6fc7de4817a21de21d2f7ddf35)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:11.003906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:11.076931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c45ee6fc7de4817a21de21d2f7ddf35'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.089494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c45ee6fc7de4817a21de21d2f7ddf35'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.089842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c45ee6fc7de4817a21de21d2f7ddf35'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.090891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c45ee6fc7de4817a21de21d2f7ddf35'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.101130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7b09bb02-cfb1-464a-97f4-c09579d8ebb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c45ee6fc7de4817a21de21d2f7ddf35'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.127830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 885/1768] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:10 2022] DELETE /identity/v3/users/4c45ee6fc7de4817a21de21d2f7ddf35 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:11.132734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.133644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.134133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.146921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae805d-fc83-43c4-a316-fdb7ba248491 None None] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.147428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae805d-fc83-43c4-a316-fdb7ba248491 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.147846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae805d-fc83-43c4-a316-fdb7ba248491 None None] PATH_INFO: `/` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.149720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 886/1769] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:45:11.164438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:11.165850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.173099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.173647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.174139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.212239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] MFA Rules not processed for user `2e40067b250f40d997dad1817ccbbba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:11.213404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.344115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 884/1770] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:11.346992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:11.371934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:11.380861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.389187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:11.393537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.423788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b43f5-28eb-4518-b563-a0596c4faace None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:11.437310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:11.437310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.437310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.437310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.451117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:11.490579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:11.498491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224b10d-8986-456a-86a1-6ce7e8f82eb2 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:11.504464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 885/1772] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:11 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:11.505668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:11.507318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.516962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:11.517680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.517972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.518249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.522132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce312-bc1a-4752-84be-a623de1dfa7d service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:11.526998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:11.528067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.528557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.529112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] PATH_INFO: `/v3/projects/b7a6da0424eb4d518396d3da483e15cb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.530418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a6da0424eb4d518396d3da483e15cb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:11.547159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:11.558880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:11.622807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc30b1-5b18-490f-b8fa-837b8a2413a6 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:11.642890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 888/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:11.662628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a6da0424eb4d518396d3da483e15cb', 'request_id': 'req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.676944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a6da0424eb4d518396d3da483e15cb', 'request_id': 'req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.689356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a6da0424eb4d518396d3da483e15cb', 'request_id': 'req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.702155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] The token cache is being invalidate because project b7a6da0424eb4d518396d3da483e15cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:11.702459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.703180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-283fe54d-4a06-4aa8-8b85-7ab4805a7b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:11.708186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 886/1774] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:11 2022] DELETE /identity/v3/projects/b7a6da0424eb4d518396d3da483e15cb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:11.709962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.710277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.710594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.737649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:11.740104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.831579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 889/1775] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:11.839600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.839891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.840289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.875094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:11.876198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:11.889961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 887/1776] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:11.894298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:11.907070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ca98f-0cee-4e10-949c-0521049f504c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:11.914494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:11.915218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.915512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.915871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.916639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:11.916990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:11.949073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:11.967783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 890/1777] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:11.972066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:11.984743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5774f5-b5ac-4aa1-a5f6-daed20f9145f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:11.990291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:11.991342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:11.991878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:11.992173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:11.992814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.034326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:12.062487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 888/1778] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:11 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:12.066570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:12.076973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fe9-8d32-46fa-84f2-4549b4b9e442 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:12.143179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:12.143712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.144005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.144283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.144925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.172144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:12.193282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 891/1779] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:12 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:12.197371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:12.208828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9740b4-df1a-4dc3-afbe-2b696405d229 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:12.213231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:12.213831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.214125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.214419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.215181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.241419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dbd0a-f167-45fd-8210-9d508a518979 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:12.251890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 889/1780] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:12.256073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:12.265941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c28f-d853-4085-921d-cc2800007469 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:12.271487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:12.272368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.272910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.273205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] PATH_INFO: `/v3/projects/64860151ac9240d3ae9d756b28b32eea/users/450916501a5741b98fdc589492a1d51b/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.294611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64860151ac9240d3ae9d756b28b32eea, user_id=450916501a5741b98fdc589492a1d51b, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.321096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ad51b-969f-4784-b3c7-ecd7a8c7e2e7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:12.337303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 892/1781] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:12 2022] PUT /identity/v3/projects/64860151ac9240d3ae9d756b28b32eea/users/450916501a5741b98fdc589492a1d51b/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:12.349394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.349939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.350053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.388683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.389436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.389436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.413743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] MFA Rules not processed for user `b68bc45984974d6da1c9151c21dae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:12.415321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:12.420666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] MFA Rules not processed for user `450916501a5741b98fdc589492a1d51b`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:12.422397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:12.490811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 893/1782] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:12 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:12.513167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 890/1783] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:12 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:12.527478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:12.528940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:12.612309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740563c-07e2-4c07-89e6-494a98d0de4a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:12.616656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:12.617459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.617841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.618173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.628269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.655676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:12.666073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 894/1784] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:12.709403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:12.710462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:12.820117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275181d-9d87-4b1f-8fbf-932665e4fbbb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:12.827048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:12.827862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:12.828163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:12.828434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] PATH_INFO: `/v3/projects/ca50aaf96a0e4bb89ecc45ab4c84f9de` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:12.831383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca50aaf96a0e4bb89ecc45ab4c84f9de)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:12.867647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:13.002130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca50aaf96a0e4bb89ecc45ab4c84f9de', 'request_id': 'req-9a2f135b-a26a-4fde-8c44-749be128335a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.033077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca50aaf96a0e4bb89ecc45ab4c84f9de', 'request_id': 'req-9a2f135b-a26a-4fde-8c44-749be128335a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.059805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca50aaf96a0e4bb89ecc45ab4c84f9de', 'request_id': 'req-9a2f135b-a26a-4fde-8c44-749be128335a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.090826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] The token cache is being invalidate because project ca50aaf96a0e4bb89ecc45ab4c84f9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:13.091185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.091868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.093362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 891/1785] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:12 2022] DELETE /identity/v3/projects/ca50aaf96a0e4bb89ecc45ab4c84f9de => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:13.097554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:13.110903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b84eb-4748-4475-8731-d5673401f2f3 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:13.194324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:13.195230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:13.195523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:13.195805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] PATH_INFO: `/v3/users/d86a87a04756428a985b11c471a2c7bb` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:13.197046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86a87a04756428a985b11c471a2c7bb)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:13.226958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:13.308715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86a87a04756428a985b11c471a2c7bb'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.330128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86a87a04756428a985b11c471a2c7bb'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.330128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86a87a04756428a985b11c471a2c7bb'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.330128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86a87a04756428a985b11c471a2c7bb'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.337757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7c59b7f-33ef-4bac-8f89-4752a56853b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86a87a04756428a985b11c471a2c7bb'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.364850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 895/1786] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:13 2022] DELETE /identity/v3/users/d86a87a04756428a985b11c471a2c7bb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:13.830458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:13.833680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:13.852116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f135b-a26a-4fde-8c44-749be128335a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:13.957008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:13.958372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:13.959780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:13.960086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] PATH_INFO: `/v3/projects/35409ec2890d492fae9b9d574d91cbb9` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:13.961483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=35409ec2890d492fae9b9d574d91cbb9)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:13.991653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.169297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35409ec2890d492fae9b9d574d91cbb9', 'request_id': 'req-159fa5bf-324d-440b-b040-bb744adbc0aa'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.193749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35409ec2890d492fae9b9d574d91cbb9', 'request_id': 'req-159fa5bf-324d-440b-b040-bb744adbc0aa'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.229515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35409ec2890d492fae9b9d574d91cbb9', 'request_id': 'req-159fa5bf-324d-440b-b040-bb744adbc0aa'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.252116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] The token cache is being invalidate because project 35409ec2890d492fae9b9d574d91cbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:14.252449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.253495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-159fa5bf-324d-440b-b040-bb744adbc0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.255782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 892/1787] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:13 2022] DELETE /identity/v3/projects/35409ec2890d492fae9b9d574d91cbb9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:14.261905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.262373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.262480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.312147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:14.313951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:14.409064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 896/1788] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:14.417494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.417847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.418136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.467955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:14.469164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:14.480700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 893/1789] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:14.484693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.494958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3ffd-d8d7-4984-953f-b36e7725247a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.510545 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.515394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.515693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.516222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.516944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:14.517258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:14.619893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.657933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.669462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 897/1790] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:14.671673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0eabf-e94f-480e-9dfd-a51ebb906fc2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.684479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.685326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.685644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.686222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.689574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:14.757144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.800964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 894/1791] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:14.802720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.818030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffffc7-3e9c-4e51-b35e-28c6d4b7898c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.983836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.984832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.985980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.986810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.989047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:15.066602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:15.111298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 898/1792] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:15.112452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:15.127742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded04-9755-4cb5-a095-8bc96711102c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:15.138293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:15.140151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.141820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.142217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.144327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:15.175033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54741e4f-85cf-4034-ae7f-b68407b8bbad admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:15.232063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 895/1793] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:15.236396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:15.250049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee4ae-d969-4c91-97e0-f65559907a94 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:15.264661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:15.271055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.272041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.272932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] PATH_INFO: `/v3/projects/1a54ed47a8dc4278bcbb94209a1f3c34/users/b360c0ae15bb4a8caff519c32c5ffc1f/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.331566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a54ed47a8dc4278bcbb94209a1f3c34, user_id=b360c0ae15bb4a8caff519c32c5ffc1f, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:15.416130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:15.455547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 899/1794] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:15 2022] PUT /identity/v3/projects/1a54ed47a8dc4278bcbb94209a1f3c34/users/b360c0ae15bb4a8caff519c32c5ffc1f/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:15.456775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.457077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.458062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.524081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] MFA Rules not processed for user `b360c0ae15bb4a8caff519c32c5ffc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:15.526179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:15.638543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:15.650659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 896/1795] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:15 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:15.722093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a5c8-1f80-4d35-af3e-40720652f826 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:15.727664 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:15.728280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.728575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.729042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.729759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:15.757994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:15.804585 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:15.812872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 900/1796] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:15 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:15.818194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41223-5cd6-4d82-99ec-d8b9b79e5fd9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:15.995519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:15.996165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.996529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.996815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.997470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:16.058243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:16.114026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 897/1797] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:15 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:16.118116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:16.136991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71b849-63a8-48d2-b8f3-82fdafa2a685 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:16.142567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:16.143825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:16.143825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:16.144142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:16.144722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:16.185201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70760-3a4c-4c9c-9814-d74b3dfdd792 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:16.212016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:16.225627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c718dca-d3fc-47a2-8746-68c00a14721a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:16.229593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 901/1798] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:16.233467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:16.234620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:16.235082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:16.235500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] PATH_INFO: `/v3/projects/2ecd07a8d39645809d6f3b3eb2c321c0/users/d4b5b24451614daf904e5bc2a0d3ad76/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:16.296027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecd07a8d39645809d6f3b3eb2c321c0, user_id=d4b5b24451614daf904e5bc2a0d3ad76, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:16.361182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:16.397878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 898/1799] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:16 2022] PUT /identity/v3/projects/2ecd07a8d39645809d6f3b3eb2c321c0/users/d4b5b24451614daf904e5bc2a0d3ad76/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:16.408419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:16.411379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:16.411935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:16.470902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] MFA Rules not processed for user `d4b5b24451614daf904e5bc2a0d3ad76`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:16.472254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:16.570631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 902/1800] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:16 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:16.571564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:16.719956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994d063-d2ed-4433-b734-55298d373137 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:16.725338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:16.726125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:16.726424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:16.727048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:16.727889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:16.795404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:16.877266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 899/1801] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:16 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:16.878975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:16.902391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1d635-dba9-4440-a066-aad2ff7e34b9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.115592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.116211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.116504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.116787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.117489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.170062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.219996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 903/1802] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:16 2022] POST /identity/v3/users => generated 300 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:17.221310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.235079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2b9-6b56-4730-85aa-92c45688fef5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.240475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.241274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.241737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.242164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.243210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.273403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.290844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 900/1803] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:17.291844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.304279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec8b18-6f3f-4cc0-be06-b814cc36cb9e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.309047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.309884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.310174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.310455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] PATH_INFO: `/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.333540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d7e2b5415549e68e38ba8641127534, user_id=02fd4427bfc9496a9fea7e3e03821efb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.365419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.388507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 904/1804] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:17 2022] PUT /identity/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:17.389884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.401801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a265-fd8b-463b-94bf-0588f897e1c8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.489975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.490843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.491272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.491692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.492587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.524336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.536488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 901/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:17.540015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.549813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45099b8-8bff-4518-9e51-7cd316a57b7e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.555293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.556102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.556394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.556674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] PATH_INFO: `/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.558414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d7e2b5415549e68e38ba8641127534, user_id=02fd4427bfc9496a9fea7e3e03821efb, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.589296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.601400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 905/1806] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:17 2022] PUT /identity/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:17.605114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.635993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c6122-f0b6-4fa7-8444-bb5dd66c0aa4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.706083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.706715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.707008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.707323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.708021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.734110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f14ba8-1e66-4925-8ea9-dcd2cb705842 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.749944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 902/1807] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:17.751405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.766701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d832b-7fbe-421d-a6f3-fb72c1de0bdf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.771488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.772399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.772750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.773038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] PATH_INFO: `/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.774839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d7e2b5415549e68e38ba8641127534, user_id=02fd4427bfc9496a9fea7e3e03821efb, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:17.802478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.817716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 906/1808] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:17 2022] PUT /identity/v3/projects/91d7e2b5415549e68e38ba8641127534/users/02fd4427bfc9496a9fea7e3e03821efb/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:17.827945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.828242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.828525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.867923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] MFA Rules not processed for user `02fd4427bfc9496a9fea7e3e03821efb`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:17.868474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:17.954443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 903/1809] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:17 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:17.964703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.966756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:18.044752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b92e0e-8ede-45fc-80d3-28497d38c5b7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:18.048412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:18.049253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:18.049781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:18.050166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:18.060823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:18.093411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:18.113337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 907/1810] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:18.771613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:18.773104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:18.784240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d256e-2ec6-48c9-962d-8b6b1c462157 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:18.787759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:18.788348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:18.788642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:18.788930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:18.851945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:18.884985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e998-d0ae-4ca3-b8ea-2b1e548a18b9 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:18.894472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 904/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:18 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:28.728072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:28.729487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:28.833314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669b219-ac85-449b-b0b7-8428ce1c2a24 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:28.838285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:28.839260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:28.839549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:28.839822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] PATH_INFO: `/v3/users/450916501a5741b98fdc589492a1d51b` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:28.841185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450916501a5741b98fdc589492a1d51b)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:28.879622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:28.936100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450916501a5741b98fdc589492a1d51b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:28.956122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450916501a5741b98fdc589492a1d51b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:28.958458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450916501a5741b98fdc589492a1d51b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:28.959744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450916501a5741b98fdc589492a1d51b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:28.969041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450916501a5741b98fdc589492a1d51b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:28.990512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 908/1812] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:28 2022] DELETE /identity/v3/users/450916501a5741b98fdc589492a1d51b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:28.992092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:28.992560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:28.992720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:29.020951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:29.022214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:29.115604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 905/1813] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:29.128193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:29.130759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:29.256425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0207d-db53-49db-b4d3-2e86625ff1e2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:29.260062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:29.260662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:29.260953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:29.261234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:29.274839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:29.304276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241af6b-3c23-45c4-9445-36a152f3f6e7 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:29.326816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 909/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:29.812407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:29.813868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:29.828819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039e218-5c49-4280-9a0e-cad146584f4f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:29.834926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:29.835788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:29.836072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:29.836358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] PATH_INFO: `/v3/projects/64860151ac9240d3ae9d756b28b32eea` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:29.837480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64860151ac9240d3ae9d756b28b32eea)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:29.867946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:29.931153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64860151ac9240d3ae9d756b28b32eea', 'request_id': 'req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:29.943045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64860151ac9240d3ae9d756b28b32eea', 'request_id': 'req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:29.962455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64860151ac9240d3ae9d756b28b32eea', 'request_id': 'req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:29.978019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] The token cache is being invalidate because project 64860151ac9240d3ae9d756b28b32eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:29.978315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:29.978970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ee0a7471-821c-4ed0-a504-cd38e4a6ff98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:29.980831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 906/1815] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:29 2022] DELETE /identity/v3/projects/64860151ac9240d3ae9d756b28b32eea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:29.985474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:29.985979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:29.986076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.019333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:30.020627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.091996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 910/1816] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:30.101038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.101540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.101639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.127226 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:30.129912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.137664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 907/1817] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:30.142216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.153181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb62614-7997-491d-8d38-f6026afd6c44 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.164708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.165402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.165883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.166168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.166906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:30.167355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.193171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.195284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.198084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.214702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 911/1818] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:45:30.216755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.226885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d492-d14b-4179-8bc4-0cf29fd553cd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.232336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.232935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.234494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.234999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.235663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.270258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.276280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb6c6f-f243-4e87-bbc5-472beaed331c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.280187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.281040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.281729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.282272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.284399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.315367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 912/1819] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:30 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:30.321341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.372408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.399359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.404672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48c94-f73b-4964-95d1-f5552d6ceb0d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.408830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 908/1820] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:30.411461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.412176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.412570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.412968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.413702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.440361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.463889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 913/1821] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:30 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:30.468481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.481106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43259b-9d72-4ccb-bd59-36975c391b5b service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.485706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.486318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.486611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.487010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.487745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.513921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d158238-90fd-42d1-b2d2-b257d2be4076 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.527172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 909/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:30.531127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.547314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c0f4a-a014-467e-bbe4-916d5535d5e8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.552557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.553507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.553885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.554262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] PATH_INFO: `/v3/projects/b239f81ce4f74f979ab73a02ece0a79b/users/b6cb2dd03d3d47a6bddb7b8c1cf0612f/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.577945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b239f81ce4f74f979ab73a02ece0a79b, user_id=b6cb2dd03d3d47a6bddb7b8c1cf0612f, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:30.611754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.630979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 914/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:30 2022] PUT /identity/v3/projects/b239f81ce4f74f979ab73a02ece0a79b/users/b6cb2dd03d3d47a6bddb7b8c1cf0612f/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:30.641887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.642346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.643307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.693912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] MFA Rules not processed for user `b6cb2dd03d3d47a6bddb7b8c1cf0612f`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:30.695569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.824194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 910/1824] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:30.915770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.917778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:31.074025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bf81f-c129-4002-9d9e-7e003611cfe3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:31.079472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:31.080214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:31.080737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:31.081122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:31.095216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:31.136290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34d47c-207f-4d5e-9893-9e56152cea6d service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:31.150186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 915/1825] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:32.209348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.211335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.292773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a35fc6-b93a-49ca-949c-8bfbe559e671 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.297010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.297929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.298286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.298637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] PATH_INFO: `/v3/users/b54b82bed77a4ee6867f53b9fddfa56e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.299858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54b82bed77a4ee6867f53b9fddfa56e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:32.326471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.393105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54b82bed77a4ee6867f53b9fddfa56e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.412292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54b82bed77a4ee6867f53b9fddfa56e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.415304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54b82bed77a4ee6867f53b9fddfa56e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.416111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54b82bed77a4ee6867f53b9fddfa56e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.426546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54b82bed77a4ee6867f53b9fddfa56e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.442094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 911/1826] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:32 2022] DELETE /identity/v3/users/b54b82bed77a4ee6867f53b9fddfa56e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:32.447571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.448551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.449274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.477605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:32.479429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.563030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 916/1827] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:32.573985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.575344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.639420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7ca64-6caf-48cf-b34f-459d190f720a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.643145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.643669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.644938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.645296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.655355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:32.681336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.690612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 912/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:33.112094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.113809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:33.129014 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906dff-c1a6-4c6f-8d57-57a56ed7203d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.147522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.148527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.150839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.151212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] PATH_INFO: `/v3/projects/fca9f5cfaba248a88149e8cf6aedca41` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.152932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca9f5cfaba248a88149e8cf6aedca41)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:33.220273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.309861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca9f5cfaba248a88149e8cf6aedca41', 'request_id': 'req-306a21dc-88be-47b6-9577-87fc79744f58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.317652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca9f5cfaba248a88149e8cf6aedca41', 'request_id': 'req-306a21dc-88be-47b6-9577-87fc79744f58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.332672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca9f5cfaba248a88149e8cf6aedca41', 'request_id': 'req-306a21dc-88be-47b6-9577-87fc79744f58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.347082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] The token cache is being invalidate because project fca9f5cfaba248a88149e8cf6aedca41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:33.347668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.348324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.349768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 917/1829] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:33 2022] DELETE /identity/v3/projects/fca9f5cfaba248a88149e8cf6aedca41 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:33.353879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.363891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f9ef9-9849-401b-a1ab-63e46720a389 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.465969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.466861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.467159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.467444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] PATH_INFO: `/v3/users/b1167774f1fd472caba46bf51786daf5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.468559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1167774f1fd472caba46bf51786daf5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:33.502824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.603929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1167774f1fd472caba46bf51786daf5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.621517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1167774f1fd472caba46bf51786daf5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.623532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1167774f1fd472caba46bf51786daf5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.624324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1167774f1fd472caba46bf51786daf5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.637240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ebecc49f-cab5-4593-b8aa-90899a9fab2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1167774f1fd472caba46bf51786daf5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.660884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 913/1830] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:33 2022] DELETE /identity/v3/users/b1167774f1fd472caba46bf51786daf5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:33.897554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.900744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:33.923307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a21dc-88be-47b6-9577-87fc79744f58 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.036782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.037751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.038020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.038302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] PATH_INFO: `/v3/users/b360c0ae15bb4a8caff519c32c5ffc1f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.041366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b360c0ae15bb4a8caff519c32c5ffc1f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:34.068049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.128354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b360c0ae15bb4a8caff519c32c5ffc1f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.138853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b360c0ae15bb4a8caff519c32c5ffc1f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.140025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b360c0ae15bb4a8caff519c32c5ffc1f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.141207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b360c0ae15bb4a8caff519c32c5ffc1f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.153167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b360c0ae15bb4a8caff519c32c5ffc1f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.172550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 918/1831] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:33 2022] DELETE /identity/v3/users/b360c0ae15bb4a8caff519c32c5ffc1f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:34.177308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.177591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.177883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.203423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:34.211751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.292279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.294107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.332985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 914/1832] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:34.340400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.341755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.401240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1e08-17a6-409d-9100-44ae72995b7c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.408437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.409353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.410190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.411031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] PATH_INFO: `/v3/projects/527894605a574289861aecf9ea2fabfb` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.411612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527894605a574289861aecf9ea2fabfb)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:34.438439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.468779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655072a-3454-4eb2-94fd-2e44b1831bc8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.474093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.474720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.475237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.475547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.486445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:34.502553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527894605a574289861aecf9ea2fabfb', 'request_id': 'req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.509896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527894605a574289861aecf9ea2fabfb', 'request_id': 'req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.514923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155837-52b5-4b70-929d-6978627a4150 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.525676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527894605a574289861aecf9ea2fabfb', 'request_id': 'req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.528028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 915/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:34.546494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] The token cache is being invalidate because project 527894605a574289861aecf9ea2fabfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:34.547067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.547771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9ad3aae1-035f-4b81-a6f7-9a87cecd5c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.550775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 919/1834] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:34 2022] DELETE /identity/v3/projects/527894605a574289861aecf9ea2fabfb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:34.556256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.556551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.556833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.593110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:34.595497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.686811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 916/1835] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:34.687990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.688301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.688594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.722266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:34.724140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.739507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.748887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 920/1836] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:34.754320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa350b8-f05a-4e61-93d7-ab6dd0ae84bb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.777628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.779266 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.781096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.781505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.785394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:34.785394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:34.821074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.838931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 917/1837] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:34.843662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.858424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a8cd-0998-40db-9fd0-140bf2e25c3b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.865529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.866364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.866844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.867230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.868049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:34.902805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.951943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.962711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 921/1838] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:34 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:34.963572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e140fc-e216-4a2e-9024-0f83fbe746e9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.048831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.050087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.050446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.052016 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.052695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.130713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.161397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 918/1839] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:34 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:35.163483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.179774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.181778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.183243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fca2e-7d52-4aad-b918-96043d519e95 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.195326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.196043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.196400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.196816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.197523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.209993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925ffd-1168-4ca1-a243-472072797a50 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.221771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.223238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.223579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.223967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] PATH_INFO: `/v3/projects/1a54ed47a8dc4278bcbb94209a1f3c34` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.235524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a54ed47a8dc4278bcbb94209a1f3c34)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.256219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.283055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 922/1840] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:35.291406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.291837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.310237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334add9e-6e16-49c4-89c6-aa44389ad56d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.323001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.323852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.324139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.324415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] PATH_INFO: `/v3/projects/eb42f913db754e4492867d85caa57a3c/users/6c0e255b2ba74edfac41ec744360edc6/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.371025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb42f913db754e4492867d85caa57a3c, user_id=6c0e255b2ba74edfac41ec744360edc6, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.407457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e769a6-538d-400b-b831-90316faef63d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.417050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a54ed47a8dc4278bcbb94209a1f3c34', 'request_id': 'req-991255a9-57ee-4b87-8515-30f00129900e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.440132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 923/1841] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:35 2022] PUT /identity/v3/projects/eb42f913db754e4492867d85caa57a3c/users/6c0e255b2ba74edfac41ec744360edc6/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:35.440322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a54ed47a8dc4278bcbb94209a1f3c34', 'request_id': 'req-991255a9-57ee-4b87-8515-30f00129900e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.445327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.445745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.446037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.459216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a54ed47a8dc4278bcbb94209a1f3c34', 'request_id': 'req-991255a9-57ee-4b87-8515-30f00129900e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.472082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] The token cache is being invalidate because project 1a54ed47a8dc4278bcbb94209a1f3c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:35.472825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.473222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.477486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 919/1842] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:35 2022] DELETE /identity/v3/projects/1a54ed47a8dc4278bcbb94209a1f3c34 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:35.480670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.482332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.501111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] MFA Rules not processed for user `6c0e255b2ba74edfac41ec744360edc6`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:35.502264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.595466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991255a9-57ee-4b87-8515-30f00129900e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.620106 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 924/1843] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:35.621194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.622703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.679797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.680619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.680914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.681208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] PATH_INFO: `/v3/users/d4b5b24451614daf904e5bc2a0d3ad76` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.682810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b5b24451614daf904e5bc2a0d3ad76)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.714314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be85b5-0f4f-4591-852c-b22c9af99b26 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.719149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.720977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.721594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.721883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.722726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.723378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:35.749670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.784282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 925/1844] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:35 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:35.789248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.813998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b5b24451614daf904e5bc2a0d3ad76'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.828926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b5b24451614daf904e5bc2a0d3ad76'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.830144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b5b24451614daf904e5bc2a0d3ad76'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.831044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b5b24451614daf904e5bc2a0d3ad76'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.859538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b5b24451614daf904e5bc2a0d3ad76'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.884093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba6f2b-e312-4f09-8c1e-2dfd68388a84 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.885433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 920/1845] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:35 2022] DELETE /identity/v3/users/d4b5b24451614daf904e5bc2a0d3ad76 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:35.957596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.958866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.959363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.960424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.962451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.023026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.051415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 926/1846] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:35 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:36.055718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.057305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.074120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a82750-c46e-4d74-8a11-8dcf185733a2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.079507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.080515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.080867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.081164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.082031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.113459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.126711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 921/1847] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:36.130398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.141671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50360-64da-4953-825b-aad2917ca9c6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.149924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.151007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.151394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.151771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] PATH_INFO: `/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.186698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7821b1f7bba4dddad67d64577232691, user_id=e40f89cfd6cd460199bc468b03fb42b5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.224038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.252647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 927/1848] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:36 2022] PUT /identity/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:36.254233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.266255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d8804-ab84-48ec-9c52-803d07297eba admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.349752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.349940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.350235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.350875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.351721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.379249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.394810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 922/1849] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:36.395261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.405296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180a9f-1c4e-45a3-8f51-fe45ef9bf8f8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.412834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.414969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.415341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.415687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] PATH_INFO: `/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.418287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7821b1f7bba4dddad67d64577232691, user_id=e40f89cfd6cd460199bc468b03fb42b5, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.453772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.455484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.455614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.467146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 928/1850] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:36 2022] PUT /identity/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:36.470764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.470873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1f040-3e7c-455f-9a5a-d490fc77b77e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.559653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.561052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.561345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.561653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] PATH_INFO: `/v3/projects/2ecd07a8d39645809d6f3b3eb2c321c0` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.563023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecd07a8d39645809d6f3b3eb2c321c0)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.578399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7447f-d290-4da6-bfaf-970bf9fa1df4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.595191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.600327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.601443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.601746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.602374 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.603822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.648048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.659082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 929/1851] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:36.663783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.666808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecd07a8d39645809d6f3b3eb2c321c0', 'request_id': 'req-3b73e6f9-1983-4e5f-b33f-e22574055a79'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.673686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3beed6-dab7-4fb8-8acb-7c9ab4fea28d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.677653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecd07a8d39645809d6f3b3eb2c321c0', 'request_id': 'req-3b73e6f9-1983-4e5f-b33f-e22574055a79'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.693442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecd07a8d39645809d6f3b3eb2c321c0', 'request_id': 'req-3b73e6f9-1983-4e5f-b33f-e22574055a79'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.706627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] The token cache is being invalidate because project 2ecd07a8d39645809d6f3b3eb2c321c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:36.707383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.708216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.713287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 923/1852] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:36 2022] DELETE /identity/v3/projects/2ecd07a8d39645809d6f3b3eb2c321c0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:36.714213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.715578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.745854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.747288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.747661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.748127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] PATH_INFO: `/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.750336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7821b1f7bba4dddad67d64577232691, user_id=e40f89cfd6cd460199bc468b03fb42b5, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.780165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce12ec-91d6-439b-966e-ab10a61b74c3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.804692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 930/1853] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:36 2022] PUT /identity/v3/projects/a7821b1f7bba4dddad67d64577232691/users/e40f89cfd6cd460199bc468b03fb42b5/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:36.806300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.806641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.807039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.810229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73e6f9-1983-4e5f-b33f-e22574055a79 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.857367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] MFA Rules not processed for user `e40f89cfd6cd460199bc468b03fb42b5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:36.858650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.893858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.895356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.895571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.895847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] PATH_INFO: `/v3/users/02fd4427bfc9496a9fea7e3e03821efb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.896993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fd4427bfc9496a9fea7e3e03821efb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:36.923673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.969361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 931/1854] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:36.980182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.983121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:37.005218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fd4427bfc9496a9fea7e3e03821efb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:37.022014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fd4427bfc9496a9fea7e3e03821efb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:37.022916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fd4427bfc9496a9fea7e3e03821efb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:37.023529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fd4427bfc9496a9fea7e3e03821efb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:37.043778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fd4427bfc9496a9fea7e3e03821efb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:37.066882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 924/1855] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:36 2022] DELETE /identity/v3/users/02fd4427bfc9496a9fea7e3e03821efb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:37.115201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61821115-8d18-41c3-a2b7-167efef169d9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:37.259098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:37.259776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:37.263820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:37.267107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:37.272008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:37.437330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:37.469641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa5a58-c786-4f21-ab6e-67b9bebd5669 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:37.497898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 932/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:38.081610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.084577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:38.262482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e4580-c57c-425c-b081-31de8eb22044 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.274119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.275123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.275419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.275840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] PATH_INFO: `/v3/projects/91d7e2b5415549e68e38ba8641127534` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.282555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d7e2b5415549e68e38ba8641127534)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:38.333352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:38.401432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d7e2b5415549e68e38ba8641127534', 'request_id': 'req-0f49fdc5-e6c8-452d-b099-87591ba62bdd'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:38.419706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d7e2b5415549e68e38ba8641127534', 'request_id': 'req-0f49fdc5-e6c8-452d-b099-87591ba62bdd'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:38.435499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d7e2b5415549e68e38ba8641127534', 'request_id': 'req-0f49fdc5-e6c8-452d-b099-87591ba62bdd'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:38.451168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] The token cache is being invalidate because project 91d7e2b5415549e68e38ba8641127534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:38.451616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:38.452257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0f49fdc5-e6c8-452d-b099-87591ba62bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:38.454162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 925/1857] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:38 2022] DELETE /identity/v3/projects/91d7e2b5415549e68e38ba8641127534 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:38.461248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.462135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.462694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.490290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:38.491781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:38.568837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 933/1858] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:38.577970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.578272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.578564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.605118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:38.607528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:38.616106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 926/1859] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:38.620402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.632371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466addca-07a0-4c04-8ede-1c6d6c8cbc03 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.645399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.646234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.646695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.647140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.648120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:45:38.648731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:38.680263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:38.696593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 934/1860] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:38.700822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.711020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc8939-0d80-4ca4-9828-289e7fe0a7bc None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.715939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.716659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.716956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.717305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.718014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:38.749554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:38.777915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 927/1861] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:38 2022] POST /identity/v3/projects => generated 407 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:38.781852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.791438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea0e-17fa-4e86-886d-42b4591ca209 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.853428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.854033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.854325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.854607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.855289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:38.881531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:38.901595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 935/1862] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:38 2022] POST /identity/v3/users => generated 304 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:38.905829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.916641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4ede-4799-4adc-ae07-3836ff5caf60 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.920886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.921481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.921791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.922064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:38.922783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:38.949168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e82646-22d4-48e2-b033-ad4e31572ee7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:38.960391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 928/1863] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:38.964331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:38.974250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4945a-6ce6-4738-8189-d2192b6bb24a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:38.980629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:38.981922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:38.982243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:38.982558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] PATH_INFO: `/v3/projects/83411d08731549b4a5a9c577c2a538df/users/cea2ec490c3a483e8fd91edabfbceac4/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.004754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83411d08731549b4a5a9c577c2a538df, user_id=cea2ec490c3a483e8fd91edabfbceac4, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.034985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.054860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 936/1864] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:38 2022] PUT /identity/v3/projects/83411d08731549b4a5a9c577c2a538df/users/cea2ec490c3a483e8fd91edabfbceac4/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:39.061143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.061448 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.061784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.104117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] MFA Rules not processed for user `cea2ec490c3a483e8fd91edabfbceac4`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:39.105288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:39.185689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 929/1865] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:39 2022] POST /identity/v3/auth/tokens => generated 3714 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:39.190239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.261753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8610b20-461e-41b2-b6c3-fe8ed7b6077b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.265530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.266241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.266534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.266856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.267580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.293715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.322856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 937/1866] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:39 2022] POST /identity/v3/projects => generated 407 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:39.326799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.340321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483569f5-c06d-415c-85b7-24bc299b4058 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.415754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.416393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.416779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.417065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.417709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.445149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.468111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 930/1867] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:39 2022] POST /identity/v3/users => generated 310 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:39.471706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.482728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965bd0-fbc8-4cd3-a562-fa9ac9278f68 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.487063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.487660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.487948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.488228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.488920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.515188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.527804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 938/1868] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:39.531874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.545238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782e7b-e8c8-4ff8-a520-1b45ac9e6bea admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.549487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.550955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.551447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.551733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] PATH_INFO: `/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.572444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b8abedf01040a0925ae33ecc14336e, user_id=c7fd637cf3a04942ad1e19232328ba58, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.600658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.615839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 931/1869] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:39 2022] PUT /identity/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:39.619677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.629781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed64579-deda-421f-9c9c-bf97590360d5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.701437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.702057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.702522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.702839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.703690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.731969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.743183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 939/1870] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:39.747913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.759014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221c8f-99a3-45e2-9843-387cb74010ba admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.763770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.764586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.764880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.765164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] PATH_INFO: `/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.767230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b8abedf01040a0925ae33ecc14336e, user_id=c7fd637cf3a04942ad1e19232328ba58, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.794649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.807982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 932/1871] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:39 2022] PUT /identity/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:39.811864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.821392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859113d-d3e5-42ce-8885-d7a6df2d7107 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.885683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.886289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.886578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.886888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.887587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.914113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f4ca0-a177-4d5e-89a8-de8d1facf052 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.927984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 940/1872] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:39.931917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:39.943947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992a4f-5ed9-4a3c-8636-716de36f5c11 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:39.948707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:39.949713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:39.950108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:39.950487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] PATH_INFO: `/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:39.952586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b8abedf01040a0925ae33ecc14336e, user_id=c7fd637cf3a04942ad1e19232328ba58, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:39.979418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:39.996663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 933/1873] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:39 2022] PUT /identity/v3/projects/57b8abedf01040a0925ae33ecc14336e/users/c7fd637cf3a04942ad1e19232328ba58/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:40.008275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:40.008558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:40.008833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:40.047267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] MFA Rules not processed for user `c7fd637cf3a04942ad1e19232328ba58`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:40.048401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:40.121654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 941/1874] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3781 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:40.131698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:40.133283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:40.196918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f5a2-6d62-4f96-ad0b-4bb672fdb966 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:40.200244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:40.200826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:40.201116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:40.201398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:40.210566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:40.236106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:40.246568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 934/1875] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:40 2022] GET /identity/v3/auth/tokens => generated 3781 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:40.412207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:40.421348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204849d-c840-4e25-93d2-edfa47a5df24 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:40.424659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:40.425969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:40.426326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:40.426683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:40.490738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:40.516646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:40.525821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 942/1876] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:40 2022] GET /identity/v3/auth/tokens => generated 3714 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:52.435790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:52.444399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447ad-a105-4406-a8ee-f0826dd7e269 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:52.448396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:52.448975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:52.449262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:52.449542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:52.451367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:52.523394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:45:52.548691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04ace0-fd66-438b-8a65-11b1f8442af3 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:52.558722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 935/1877] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:52 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:19.512341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:19.591779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996c70-8d20-4ca0-b9a0-1a75997da7a0 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:19.596582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:19.597518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:19.597909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:19.598259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] PATH_INFO: `/v3/users/cea2ec490c3a483e8fd91edabfbceac4` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:19.599530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea2ec490c3a483e8fd91edabfbceac4)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:19.628281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:19.701700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea2ec490c3a483e8fd91edabfbceac4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:19.716289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea2ec490c3a483e8fd91edabfbceac4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:19.717007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea2ec490c3a483e8fd91edabfbceac4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:19.717655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea2ec490c3a483e8fd91edabfbceac4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:19.736509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea2ec490c3a483e8fd91edabfbceac4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:19.771965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 943/1878] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:19 2022] DELETE /identity/v3/users/cea2ec490c3a483e8fd91edabfbceac4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:19.776000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:19.776501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:19.776607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:19.804732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:19.806134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:19.889766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 936/1879] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:19.897793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:19.899381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:19.965706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26311b-3a39-4f57-86b6-dc7163838454 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:19.969223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:19.969942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:19.971227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:19.971553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:19.982271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:20.009332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:20.027667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 944/1880] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:20.382484 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:20.383906 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:20.397140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1ea7a-6b54-4393-a557-fc2544bdfb9a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:20.401887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:20.402763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:20.403052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:20.403343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] PATH_INFO: `/v3/projects/83411d08731549b4a5a9c577c2a538df` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:20.404531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83411d08731549b4a5a9c577c2a538df)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:20.432607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:20.484749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83411d08731549b4a5a9c577c2a538df', 'request_id': 'req-5811042c-42ef-4478-adec-3f61445a0651'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.492286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83411d08731549b4a5a9c577c2a538df', 'request_id': 'req-5811042c-42ef-4478-adec-3f61445a0651'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.504194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83411d08731549b4a5a9c577c2a538df', 'request_id': 'req-5811042c-42ef-4478-adec-3f61445a0651'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.513853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] The token cache is being invalidate because project 83411d08731549b4a5a9c577c2a538df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:20.514135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.514787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.516472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 937/1881] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:20 2022] DELETE /identity/v3/projects/83411d08731549b4a5a9c577c2a538df => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:20.520703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:20.529816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b0ee-6fed-476a-8aa9-6951f9ba8edb service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:20.593822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:20.594622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:20.595093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:20.595371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] PATH_INFO: `/v3/users/c7fd637cf3a04942ad1e19232328ba58` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:20.596551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fd637cf3a04942ad1e19232328ba58)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:20.623007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:20.670962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fd637cf3a04942ad1e19232328ba58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.678865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fd637cf3a04942ad1e19232328ba58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.679736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fd637cf3a04942ad1e19232328ba58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.680198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fd637cf3a04942ad1e19232328ba58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.688103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7a65ebe6-9f4b-4c4f-9352-fbb27a987de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fd637cf3a04942ad1e19232328ba58'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:20.706213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 945/1882] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:20 2022] DELETE /identity/v3/users/c7fd637cf3a04942ad1e19232328ba58 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:21.084826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.087085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:21.114404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811042c-42ef-4478-adec-3f61445a0651 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.199924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.200785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.201088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.201376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] PATH_INFO: `/v3/projects/57b8abedf01040a0925ae33ecc14336e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.202742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b8abedf01040a0925ae33ecc14336e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.232285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.301223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b8abedf01040a0925ae33ecc14336e', 'request_id': 'req-983a816f-d685-4236-9a62-8a183b1b2957'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:21.313806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b8abedf01040a0925ae33ecc14336e', 'request_id': 'req-983a816f-d685-4236-9a62-8a183b1b2957'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:21.326728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b8abedf01040a0925ae33ecc14336e', 'request_id': 'req-983a816f-d685-4236-9a62-8a183b1b2957'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:21.339630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] The token cache is being invalidate because project 57b8abedf01040a0925ae33ecc14336e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:21.339937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:21.340637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-983a816f-d685-4236-9a62-8a183b1b2957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:21.342254 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 938/1883] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:21 2022] DELETE /identity/v3/projects/57b8abedf01040a0925ae33ecc14336e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:21.347235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.347527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.347813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.370657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:21.371968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:21.435819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 946/1884] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:21.444067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298ad19-2700-436c-9635-e32835a64afa None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.444361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298ad19-2700-436c-9635-e32835a64afa None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.444647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298ad19-2700-436c-9635-e32835a64afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.466727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5298ad19-2700-436c-9635-e32835a64afa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:21.467879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5298ad19-2700-436c-9635-e32835a64afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:21.475846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 939/1885] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:21.480242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.492408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf2850-ac98-448b-bbd4-2da4555e96df None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.497274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.497993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.498293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.498574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.499309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:21.499667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.525701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.539640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 947/1886] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:21.543863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298ad19-2700-436c-9635-e32835a64afa None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.553406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298ad19-2700-436c-9635-e32835a64afa None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.557644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.558225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.558512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.558821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.559449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.585477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.613321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 940/1887] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:21 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:21.617394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.626969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b966339-8ad4-4f35-8629-08f8e91a9ec0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.688157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.688754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.689168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.689531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.690178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.716047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.736731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 948/1888] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:21 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:21.741281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.751563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b3da-a0f3-449f-9a74-5f3260eb8835 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.756233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.756824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.757115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.757394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.758085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.785424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba36ab6-07f4-4075-aaa8-47ffe8c91066 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.796945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 941/1889] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:21.802045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.812541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8da799-bef0-41d2-9044-cda835502e56 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:21.817121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:21.818052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.818437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.818874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] PATH_INFO: `/v3/projects/dc8bed25ca5d4714930c78da7a2ece75/users/1c4aa0c9e552433fa84159d2ee79d342/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.841647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8bed25ca5d4714930c78da7a2ece75, user_id=1c4aa0c9e552433fa84159d2ee79d342, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:21.868789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:21.881875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 949/1890] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:21 2022] PUT /identity/v3/projects/dc8bed25ca5d4714930c78da7a2ece75/users/1c4aa0c9e552433fa84159d2ee79d342/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:21.893457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fe18-846b-49a8-8785-331980e73095 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:21.893803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fe18-846b-49a8-8785-331980e73095 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:21.894274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fe18-846b-49a8-8785-331980e73095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:21.936699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-20c4fe18-846b-49a8-8785-331980e73095 None None] MFA Rules not processed for user `1c4aa0c9e552433fa84159d2ee79d342`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:21.936699 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-20c4fe18-846b-49a8-8785-331980e73095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:21.938195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:21.940469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.011697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9208ba-9522-44d1-8e94-70203e21dfbf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.012797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 942/1891] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:22.017875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.018728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.019769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.019769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] PATH_INFO: `/v3/users/2246bad06441497e9fd542cc1c84da0a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.020739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2246bad06441497e9fd542cc1c84da0a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:22.028709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d836f9-a082-434d-b0e3-eba7c4e492a1 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.029008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d836f9-a082-434d-b0e3-eba7c4e492a1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.029316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d836f9-a082-434d-b0e3-eba7c4e492a1 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.031191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 943/1892] 10.222.0.48 () {54 vars in 961 bytes} [Fri Apr 8 02:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:46:22.037291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.037617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.037908 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.047271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:22.060076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] MFA Rules not processed for user `1c47875086994711af245d3b53b617f9`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:22.061222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.098762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2246bad06441497e9fd542cc1c84da0a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.106046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2246bad06441497e9fd542cc1c84da0a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.106683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2246bad06441497e9fd542cc1c84da0a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.107292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2246bad06441497e9fd542cc1c84da0a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.115209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2246bad06441497e9fd542cc1c84da0a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.121997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 944/1893] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Apr 8 02:46:22 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:22.130115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:22.132878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 950/1894] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:21 2022] DELETE /identity/v3/users/2246bad06441497e9fd542cc1c84da0a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:22.137695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788f1c-2ebc-4ba0-b31c-235bb6445960 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.194270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.194884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.195178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.195581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.197270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.266596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:22.292808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de7019-cdff-4f3e-aa91-7453b8b28b1c service glance] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:22.302009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 945/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:22 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:22.374481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:22.379103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.471793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63c3fe-4eaa-4f87-a73a-5f30dd520ba8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.476413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.477431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.477906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.478838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] PATH_INFO: `/v3/projects/08ab2bde6dca4830a67ca00d0223b3a7` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.479630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ab2bde6dca4830a67ca00d0223b3a7)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:22.509383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:22.573578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ab2bde6dca4830a67ca00d0223b3a7', 'request_id': 'req-f2227e37-e554-4995-ac05-e0b159a3b999'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.578767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ab2bde6dca4830a67ca00d0223b3a7', 'request_id': 'req-f2227e37-e554-4995-ac05-e0b159a3b999'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.590598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ab2bde6dca4830a67ca00d0223b3a7', 'request_id': 'req-f2227e37-e554-4995-ac05-e0b159a3b999'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.605981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] The token cache is being invalidate because project 08ab2bde6dca4830a67ca00d0223b3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:22.606443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.607053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f2227e37-e554-4995-ac05-e0b159a3b999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:22.608800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 951/1896] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:22 2022] DELETE /identity/v3/projects/08ab2bde6dca4830a67ca00d0223b3a7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:22.614436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a171-bda8-4194-a245-650542686a44 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.615056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a171-bda8-4194-a245-650542686a44 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.615633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a171-bda8-4194-a245-650542686a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.641069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9479a171-bda8-4194-a245-650542686a44 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:22.642590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9479a171-bda8-4194-a245-650542686a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.714025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 946/1897] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:22.721736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.722133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.722483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.744864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:22.746016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:22.753986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 952/1898] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:22.758727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a171-bda8-4194-a245-650542686a44 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:22.768844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a171-bda8-4194-a245-650542686a44 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.773129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.773719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.774007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.774287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.775008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:22.775306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:22.801580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:22.820991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 947/1899] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:46:22.822488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:22.832474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8a176-6ef3-4c72-9a98-305beb0dde35 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.836222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.836806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.837097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.837375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.838010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:22.866349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:22.903179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 953/1900] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:22 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:22.903281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:22.912578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640b433-cd30-4293-810b-5aca29c5f14d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:22.976575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:22.977183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:22.977477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:22.977762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:22.978400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:23.004483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:23.024773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 948/1901] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:22 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:23.028964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:23.039290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069707a6-60fd-4107-bc81-11b1cf7f4aa4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:23.043523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:23.044115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:23.044405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:23.044715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:23.045409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:23.071120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c38a7-7562-4ca7-90ab-0484163b95a6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:23.081156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 954/1902] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:23.085128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:23.094554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ea38-1b77-45e7-8537-e2d05b26c45f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:23.099459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:23.100268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:23.100560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:23.100846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] PATH_INFO: `/v3/projects/d7c31bb4f3ce486591bc142b1da7553e/users/e2a88a8d7c9e4d0a88308c0e894570be/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:23.121247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c31bb4f3ce486591bc142b1da7553e, user_id=e2a88a8d7c9e4d0a88308c0e894570be, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:23.147914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:23.160924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 949/1903] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:23 2022] PUT /identity/v3/projects/d7c31bb4f3ce486591bc142b1da7553e/users/e2a88a8d7c9e4d0a88308c0e894570be/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:23.165986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295ac7-bdb2-4123-bf06-df3d9fc54124 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:23.166281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295ac7-bdb2-4123-bf06-df3d9fc54124 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:23.166566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295ac7-bdb2-4123-bf06-df3d9fc54124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:23.188834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1b295ac7-bdb2-4123-bf06-df3d9fc54124 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:23.190074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1b295ac7-bdb2-4123-bf06-df3d9fc54124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:23.253900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 955/1904] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:23.263627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:23.265539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:23.415127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e218a-80fa-42b5-ab18-b5ccb9261b5d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:23.418358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:23.418963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:23.419255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:23.419537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:23.428389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:23.452923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:23.462522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 950/1905] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:29.009581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a14-5e5c-47dc-b27c-8cb62ebfbe46 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:29.010128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a14-5e5c-47dc-b27c-8cb62ebfbe46 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:29.010529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a14-5e5c-47dc-b27c-8cb62ebfbe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:29.048782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-cc2b0a14-5e5c-47dc-b27c-8cb62ebfbe46 None None] MFA Rules not processed for user `e2a88a8d7c9e4d0a88308c0e894570be`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:29.049935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cc2b0a14-5e5c-47dc-b27c-8cb62ebfbe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:29.134217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 956/1906] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:29 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:29.149775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:29.149775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:29.262124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46799053-eaf9-405a-a67f-abb9ff2f508d service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:29.269402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:29.270007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:29.270369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:29.270869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:29.279863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:29.305304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:29.315650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 951/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:29 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:31.236614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99f71-fef4-404d-b179-92dc04a44f7c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:31.237166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99f71-fef4-404d-b179-92dc04a44f7c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:31.237512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c99f71-fef4-404d-b179-92dc04a44f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:31.348994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-39c99f71-fef4-404d-b179-92dc04a44f7c None None] MFA Rules not processed for user `e2a88a8d7c9e4d0a88308c0e894570be`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:31.350144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-39c99f71-fef4-404d-b179-92dc04a44f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:31.363072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 957/1908] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:31 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:50.559286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.560663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.649915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92728-0aca-448a-a5db-2af88943e933 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.654439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.655282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.655582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.655871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] PATH_INFO: `/v3/users/b6cb2dd03d3d47a6bddb7b8c1cf0612f` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.658620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6cb2dd03d3d47a6bddb7b8c1cf0612f)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:50.684760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.739623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6cb2dd03d3d47a6bddb7b8c1cf0612f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.756596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6cb2dd03d3d47a6bddb7b8c1cf0612f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.757586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6cb2dd03d3d47a6bddb7b8c1cf0612f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.758413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6cb2dd03d3d47a6bddb7b8c1cf0612f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.768077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6cb2dd03d3d47a6bddb7b8c1cf0612f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.783929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 952/1909] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:50 2022] DELETE /identity/v3/users/b6cb2dd03d3d47a6bddb7b8c1cf0612f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:50.788528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.789043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.789157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.827934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:50.830334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.903094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 958/1910] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:50.910825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.913595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.923118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.924661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.936881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11a89e-4a7d-4764-a123-0c6dbfedd4e9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.943173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.943590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.944725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.944725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] PATH_INFO: `/v3/users/6c0e255b2ba74edfac41ec744360edc6` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.945792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0e255b2ba74edfac41ec744360edc6)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:50.980894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.049358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0e255b2ba74edfac41ec744360edc6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.058835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0e255b2ba74edfac41ec744360edc6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.059699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0e255b2ba74edfac41ec744360edc6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.060403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0e255b2ba74edfac41ec744360edc6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.070007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-eead2bb4-d670-425e-bbce-187e84ab96d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0e255b2ba74edfac41ec744360edc6'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.092928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 959/1911] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:50 2022] DELETE /identity/v3/users/6c0e255b2ba74edfac41ec744360edc6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:51.099222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.100072 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.100707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.102034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6c2a-3274-40be-84f3-e1e9639f0cab admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.123892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:51.125303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.163505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.164199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.164498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.164786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.166530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.197633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 960/1912] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:51.210759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.212439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.228693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4b4f-ba86-47c1-9cfc-f966b9c6da9a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.235775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.236494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.236855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.237214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.256008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:51.258171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:51.290857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.295762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.307584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 953/1913] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:51.322008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 961/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:51.927967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.930357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.942322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b766cc-1d26-40c4-8701-85c05d1f78f7 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.946842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.947860 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.948320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.949785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] PATH_INFO: `/v3/projects/b239f81ce4f74f979ab73a02ece0a79b` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.951916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.953458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.955027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b239f81ce4f74f979ab73a02ece0a79b)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:51.978467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9360c-1ee3-409e-a449-6e2617b2ab69 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.983332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.984128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.984417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.985227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] PATH_INFO: `/v3/projects/eb42f913db754e4492867d85caa57a3c` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.986337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb42f913db754e4492867d85caa57a3c)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:51.993241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.013259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.048086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b239f81ce4f74f979ab73a02ece0a79b', 'request_id': 'req-6a280933-4e61-4f65-b670-9073918e0ed9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.056508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b239f81ce4f74f979ab73a02ece0a79b', 'request_id': 'req-6a280933-4e61-4f65-b670-9073918e0ed9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.068423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b239f81ce4f74f979ab73a02ece0a79b', 'request_id': 'req-6a280933-4e61-4f65-b670-9073918e0ed9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.070140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb42f913db754e4492867d85caa57a3c', 'request_id': 'req-73c15bed-ff92-463b-b59e-b8292a7477b1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.078191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] The token cache is being invalidate because project b239f81ce4f74f979ab73a02ece0a79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:52.079333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.079956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6a280933-4e61-4f65-b670-9073918e0ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.080140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb42f913db754e4492867d85caa57a3c', 'request_id': 'req-73c15bed-ff92-463b-b59e-b8292a7477b1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.081602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 954/1915] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:51 2022] DELETE /identity/v3/projects/b239f81ce4f74f979ab73a02ece0a79b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:52.086032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762c4b-f5a8-4e91-afbc-f04708953be7 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.086325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762c4b-f5a8-4e91-afbc-f04708953be7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.086610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96762c4b-f5a8-4e91-afbc-f04708953be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.091703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb42f913db754e4492867d85caa57a3c', 'request_id': 'req-73c15bed-ff92-463b-b59e-b8292a7477b1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.104795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] The token cache is being invalidate because project eb42f913db754e4492867d85caa57a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:52.105127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.105681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.107245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 962/1916] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:51 2022] DELETE /identity/v3/projects/eb42f913db754e4492867d85caa57a3c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:52.112057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.114295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.138632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-96762c4b-f5a8-4e91-afbc-f04708953be7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.140161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-96762c4b-f5a8-4e91-afbc-f04708953be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.188283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c15bed-ff92-463b-b59e-b8292a7477b1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.192953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.193797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.194137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.194424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] PATH_INFO: `/v3/users/e40f89cfd6cd460199bc468b03fb42b5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.195622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40f89cfd6cd460199bc468b03fb42b5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.212354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 955/1917] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:52.222316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.222813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.223156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.224754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.247739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.248914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.257513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 956/1918] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:52.262424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.279339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8423e5-b83d-4396-976f-40a017aba2ed None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.288335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40f89cfd6cd460199bc468b03fb42b5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.289014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.289786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.290222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.290693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.292078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:52.292078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.301482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40f89cfd6cd460199bc468b03fb42b5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.302305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40f89cfd6cd460199bc468b03fb42b5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.303053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40f89cfd6cd460199bc468b03fb42b5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.311696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40f89cfd6cd460199bc468b03fb42b5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.327509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.332832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 963/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:52 2022] DELETE /identity/v3/users/e40f89cfd6cd460199bc468b03fb42b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:52.348400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 957/1920] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:52.349915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.351311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.442089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06249a-7395-459e-b1fe-73e841936153 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.447850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.448543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.448972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.449437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.450155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.482112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.516046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 964/1921] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:52.520045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.538472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcede22-1a3f-419b-b37d-19734e5be661 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.629822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.631023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.631472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.631785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.632514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.661262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.690607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 958/1922] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:52.694638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.706598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d9644-fc30-4e70-9ad4-194879d77402 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.712481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.713548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.714088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.714327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.715095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.741105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.746466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.748419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.761797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1efc43-fb65-4123-9462-9c5274518a84 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.762483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 965/1923] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:52.763719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.767959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.769003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.769326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.769643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] PATH_INFO: `/v3/projects/a7821b1f7bba4dddad67d64577232691` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.771171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7821b1f7bba4dddad67d64577232691)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.775738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16700452-1f1c-4dab-9913-8ae05a39124a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.780192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.781019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.781336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.781648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] PATH_INFO: `/v3/projects/c8233db7fb3948b0a584c28bd63005d2/users/ee6c4ed9ffb84d2481bc48dde9cb11a0/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.803129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8233db7fb3948b0a584c28bd63005d2, user_id=ee6c4ed9ffb84d2481bc48dde9cb11a0, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:52.803778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.831121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee01c-f992-475b-8b36-8751723e8d4e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.856706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 966/1924] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:52 2022] PUT /identity/v3/projects/c8233db7fb3948b0a584c28bd63005d2/users/ee6c4ed9ffb84d2481bc48dde9cb11a0/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:52.860209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.860209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.860209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.899368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7821b1f7bba4dddad67d64577232691', 'request_id': 'req-9fab8c78-4824-4537-a885-a38f77587def'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.911230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7821b1f7bba4dddad67d64577232691', 'request_id': 'req-9fab8c78-4824-4537-a885-a38f77587def'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.913836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] MFA Rules not processed for user `ee6c4ed9ffb84d2481bc48dde9cb11a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.916061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.951656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7821b1f7bba4dddad67d64577232691', 'request_id': 'req-9fab8c78-4824-4537-a885-a38f77587def'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.974695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] The token cache is being invalidate because project a7821b1f7bba4dddad67d64577232691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:52.974978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.975724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9fab8c78-4824-4537-a885-a38f77587def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.985066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 959/1925] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:52 2022] DELETE /identity/v3/projects/a7821b1f7bba4dddad67d64577232691 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:52.986993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a36a-3657-44ca-b831-84a59445bd4c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.987295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a36a-3657-44ca-b831-84a59445bd4c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.987909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4a36a-3657-44ca-b831-84a59445bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.039952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4ee4a36a-3657-44ca-b831-84a59445bd4c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.042070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4ee4a36a-3657-44ca-b831-84a59445bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.081915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 967/1926] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.092979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.095252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.129041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 960/1927] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.136594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.136969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.137322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.165019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.166267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.176616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 961/1928] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.180445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.199286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c87ff-9e0b-457b-8122-f356f6794721 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.202612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720003d-c7f6-49c1-b39a-62fc5dcf4921 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.206471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.207201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.207653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.208038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.211988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.212606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.212899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.213330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.214031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:53.214334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.217852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.253446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.254134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.272620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 962/1929] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:53.273470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.277854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 968/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:53.284035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d0ad4-3372-4cca-8042-4be035741aee admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.290156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.290791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.291086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.291369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.292010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.315732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.317177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.320403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.330533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3124a-6a8e-443b-8352-1445134903ce service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.335151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.335894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.336186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.336468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] PATH_INFO: `/v3/users/ee6c4ed9ffb84d2481bc48dde9cb11a0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.337719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6c4ed9ffb84d2481bc48dde9cb11a0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.356262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 963/1931] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:53.357432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.366461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.439005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6c4ed9ffb84d2481bc48dde9cb11a0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:53.452049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2dcf8-7ddd-4b87-906c-681466e90e38 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.458893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6c4ed9ffb84d2481bc48dde9cb11a0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:53.460016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6c4ed9ffb84d2481bc48dde9cb11a0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:53.460715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6c4ed9ffb84d2481bc48dde9cb11a0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:53.464045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.465765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.466275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.466975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.468346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.470302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4067e6fb-ad4d-45f0-a46e-106fc8ca680b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6c4ed9ffb84d2481bc48dde9cb11a0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:53.492652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 969/1932] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:53 2022] DELETE /identity/v3/users/ee6c4ed9ffb84d2481bc48dde9cb11a0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:53.500798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.501448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.501621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.505564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.530702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 964/1933] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:53.533617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.535383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.557027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9345e7-ed5c-4bd0-9540-b83f4e40a815 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.557655 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.558885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.646869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.647490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.647784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.648069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.649422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.680390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.693224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 965/1934] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:53.697570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.721109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ab53-a89e-4294-b7bd-60a47528aca3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.727786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.728261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 970/1935] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.729368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.729669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.730192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] PATH_INFO: `/v3/projects/a74b6451e87d4ef8a1338608ea90e7cc/users/6e3c9f1718ca42b7bbb958337cf6f8d3/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.734653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.736037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.757855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74b6451e87d4ef8a1338608ea90e7cc, user_id=6e3c9f1718ca42b7bbb958337cf6f8d3, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.791238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.813308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 966/1936] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:53 2022] PUT /identity/v3/projects/a74b6451e87d4ef8a1338608ea90e7cc/users/6e3c9f1718ca42b7bbb958337cf6f8d3/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:53.813308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.815418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.836550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce532da-68f8-4e6f-b0d5-ff4dc43e4450 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.904269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2083-bb08-41aa-8d9a-faa3676c577a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.913089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.913690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.914249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.914586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.915464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.916593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.917099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.917689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] PATH_INFO: `/v3/users/e7b00cf140e24432ba791f820104cf6c` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.919059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b00cf140e24432ba791f820104cf6c)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.927220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:53.953930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73d18f-aabd-48c4-800a-4c5d076f53c9 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.964772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 971/1937] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:53.965588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.965781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.966016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.984198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.990212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.991431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.998536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 972/1938] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:54.009353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:54.010903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.027701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2fad-b868-4c22-85d0-ebd2057c9cb7 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:54.033722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:54.034557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:54.034940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:54.035297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:54.047187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:54.051844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b00cf140e24432ba791f820104cf6c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:54.065041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b00cf140e24432ba791f820104cf6c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:54.065763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b00cf140e24432ba791f820104cf6c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:54.066459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b00cf140e24432ba791f820104cf6c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:54.074522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b00cf140e24432ba791f820104cf6c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:54.075325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446d57e-bf19-4479-ab0d-481f0b33c3d8 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:54.086821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 973/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:54.090613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 967/1940] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:53 2022] DELETE /identity/v3/users/e7b00cf140e24432ba791f820104cf6c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:54.095675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:54.095978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:54.096365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:54.122085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:54.123151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.196810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 974/1941] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:54.213014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:54.215011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.291634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c4b6-735a-4efa-9023-ad610f6fc9d5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:54.296061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:54.296732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:54.297608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:54.298302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:54.308606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:54.335208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03be2cf-5641-49ed-9397-d6efc0fd0f15 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:54.346021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 968/1942] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:54.891338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:54.892872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.904090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16ae82-44af-4aa4-90f2-958af829337b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:54.909499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:54.910307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:54.910744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:54.910928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] PATH_INFO: `/v3/projects/c8233db7fb3948b0a584c28bd63005d2` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:54.912119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8233db7fb3948b0a584c28bd63005d2)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:54.939576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:54.998721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8233db7fb3948b0a584c28bd63005d2', 'request_id': 'req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.005112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8233db7fb3948b0a584c28bd63005d2', 'request_id': 'req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.018196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8233db7fb3948b0a584c28bd63005d2', 'request_id': 'req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.033267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] The token cache is being invalidate because project c8233db7fb3948b0a584c28bd63005d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:55.033575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.034182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e26cd5ca-f0ae-4243-8485-4d5fe9f6a157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.035893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 975/1943] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:54 2022] DELETE /identity/v3/projects/c8233db7fb3948b0a584c28bd63005d2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:55.042987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.043523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.043604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.082702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:55.084216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.154460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 969/1944] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:55.162736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.163211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.163330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.185867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:55.187049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.194702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 976/1945] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:55.198867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.211776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4491-767b-47f9-b0b1-5331a71cee28 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.216597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.217475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.218237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.218702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.220419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:55.220926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.252309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.272632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 970/1946] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:55.273817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.292040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128714-0cba-4d1b-aaa5-ddfcf02e378f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.299141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.299758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.300051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.300338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.300982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.340064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.365755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.368530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.384033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81eb3-40c8-4e0c-9523-78971eb97b96 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.394583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.394809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 977/1947] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:55.394910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.394910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.394910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] PATH_INFO: `/v3/projects/ed5f7fee483a450284b4df5d40276682` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.394910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5f7fee483a450284b4df5d40276682)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.396075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.422066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.493773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5f7fee483a450284b4df5d40276682', 'request_id': 'req-6ae17272-9e3c-4eba-8db3-f3172bc679c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.499299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c91d5e-77f9-43de-9579-d04706f4780c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.502604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5f7fee483a450284b4df5d40276682', 'request_id': 'req-6ae17272-9e3c-4eba-8db3-f3172bc679c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.515116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5f7fee483a450284b4df5d40276682', 'request_id': 'req-6ae17272-9e3c-4eba-8db3-f3172bc679c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.529132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] The token cache is being invalidate because project ed5f7fee483a450284b4df5d40276682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:55.529510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.530378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6ae17272-9e3c-4eba-8db3-f3172bc679c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.532635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 971/1948] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:55 2022] DELETE /identity/v3/projects/ed5f7fee483a450284b4df5d40276682 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:55.533831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.534192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.534548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.572514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.573141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] MFA Rules not processed for user `6e3c9f1718ca42b7bbb958337cf6f8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:55.573279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.573526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.573851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.574516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.574960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.602195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.626541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 978/1949] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:55.627487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.629008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.640304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469275a5-4a7a-4b56-aace-42a020414e28 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.645191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.646066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.646360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.646642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] PATH_INFO: `/v3/users/51cd051292724b27a701ff9df997c078` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.647770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cd051292724b27a701ff9df997c078)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.653980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 972/1950] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:55.654982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.656281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.669132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf539e-5a81-4baa-adf1-51c6ea723ccf None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.674037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.674642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.674959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.675242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.676992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.679349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.705879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.718057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 973/1951] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:55.723061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.725134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.737642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5d54-314e-4218-af37-51838c899b1c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.745444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.746270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.747026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.747522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cd051292724b27a701ff9df997c078'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.749175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.751182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.760716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cd051292724b27a701ff9df997c078'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.762730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cd051292724b27a701ff9df997c078'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.763491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cd051292724b27a701ff9df997c078'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.779167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cd051292724b27a701ff9df997c078'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:55.779912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.803991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 979/1952] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:55 2022] DELETE /identity/v3/users/51cd051292724b27a701ff9df997c078 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:55.804819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.806201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.827068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 974/1953] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:55.830886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.832668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:55.910896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95f8f-d03d-411f-baa5-11223387be04 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.916045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.917089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.917526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.918289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] PATH_INFO: `/v3/projects/5fb44db14d6e4c14b82c05f28e8ee9d9/users/6b94017d79f24adaa76748899bc7c014/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.928858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a7fc8-5036-4973-8780-495efdc281eb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:55.941194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb44db14d6e4c14b82c05f28e8ee9d9, user_id=6b94017d79f24adaa76748899bc7c014, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.941408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:55.941952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.942183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.942480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:55.943176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:55.970992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3dbe-d33d-4041-bebb-5412b5dd1872 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.971169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:55.991443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 980/1954] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:55 2022] PUT /identity/v3/projects/5fb44db14d6e4c14b82c05f28e8ee9d9/users/6b94017d79f24adaa76748899bc7c014/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:55.996002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 975/1955] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:55.996874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:55.997146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:55.997657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:55.998179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.007698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf86c6-fab6-4228-8691-52c9b4674aed admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.027572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:56.028867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.079376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.080045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.080333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.080613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.081317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.106889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 981/1956] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:56.107840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.117848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.119150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 976/1957] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:56.119437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.123326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.133880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de4c7-f334-4279-b840-f7582e163c02 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.139287 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.140363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.141262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.141560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] PATH_INFO: `/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.163059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2e6cf4e81343d5b7ffbefd35b39248, user_id=78f74228c62a49059a35c063f53245a6, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.186162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e170-5666-404d-824e-4c3c63175f0d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.189779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.190357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.190645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.190956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.191177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.200942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.206938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 977/1958] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:56 2022] PUT /identity/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:56.210986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.228141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.238688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 982/1959] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:56.239930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.241213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.254819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ac9f4-f288-48a0-82d8-eccad47dede5 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.296474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2388e6-4249-4d58-933b-742cc62f69ad admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.301041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.301736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.302749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.302749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.303223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.328993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.329748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.329879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.330200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.330553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] PATH_INFO: `/v3/projects/20e30635bda54c79aba77e387029b8a5` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.331927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e30635bda54c79aba77e387029b8a5)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.341522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 978/1960] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:56.346296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.356935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851befc3-51dd-43a5-80ea-536d8f3dab73 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.363518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.364929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.366896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.367423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.368115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] PATH_INFO: `/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.371760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2e6cf4e81343d5b7ffbefd35b39248, user_id=78f74228c62a49059a35c063f53245a6, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.407662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.423613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 979/1961] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:56 2022] PUT /identity/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:56.432169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.437068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e30635bda54c79aba77e387029b8a5', 'request_id': 'req-2d5ff1aa-605a-456d-84be-7a8ae5486cda'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:56.452845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e30635bda54c79aba77e387029b8a5', 'request_id': 'req-2d5ff1aa-605a-456d-84be-7a8ae5486cda'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:56.471836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e30635bda54c79aba77e387029b8a5', 'request_id': 'req-2d5ff1aa-605a-456d-84be-7a8ae5486cda'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:56.494169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] The token cache is being invalidate because project 20e30635bda54c79aba77e387029b8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:56.494633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:56.495629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d5ff1aa-605a-456d-84be-7a8ae5486cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:56.497823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 983/1962] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:56 2022] DELETE /identity/v3/projects/20e30635bda54c79aba77e387029b8a5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:56.503149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a781-4e55-4aa6-a42c-e9a3616ae4e6 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.503493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a781-4e55-4aa6-a42c-e9a3616ae4e6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.503782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a781-4e55-4aa6-a42c-e9a3616ae4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.539281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02acee-0ef6-4c2e-802f-1b8b1d5a959f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.549491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4bb7a781-4e55-4aa6-a42c-e9a3616ae4e6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:56.550932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4bb7a781-4e55-4aa6-a42c-e9a3616ae4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.613428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.614208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.614622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.615069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.615863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.628294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 984/1963] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:56.632730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.633020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.633301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.644903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.656152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 980/1964] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:56.661647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.663493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.665044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:56.666440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:56.674607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 985/1965] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:56.675986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081d36a-140d-4cff-afbe-af2794558a23 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.679182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.680215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.681053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.681340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.681626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] PATH_INFO: `/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.683458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2e6cf4e81343d5b7ffbefd35b39248, user_id=78f74228c62a49059a35c063f53245a6, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.688879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011df34f-0f8a-47a2-89e8-ea7e0b9b6c16 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.692754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.693456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.693940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.694308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.695134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:46:56.695526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.710302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.722599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.729981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 981/1966] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:56 2022] PUT /identity/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248/users/78f74228c62a49059a35c063f53245a6/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:56.739840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 986/1967] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:56.744671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.846654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921781f-aa0b-440c-9895-a0ccf1f86215 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:56.852200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:56.853167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:56.853713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:56.853956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:56.854803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:56.883468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:56.916083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 982/1968] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:56 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:56.919922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:56.934065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245ffa5-baaa-4ef7-b505-ed765358c8ae admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.028899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.029594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.030573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.030959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.031718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.062030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.093098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 987/1969] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:56 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:57.097695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.111194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93ec4e-6320-4cd7-940a-10f98ffb8ec7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.117036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.117905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.119736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.120344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.121296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.155578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a3d2-6030-4b83-a365-02009b757276 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.175470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 983/1970] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:57.177228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.189976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b5c1-5747-47b7-86e9-98ce3d7d8f0b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.195180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.196792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.197294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.197776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] PATH_INFO: `/v3/projects/aa8ad4099ff6472cb0e0567b942d9c46/users/97c7f7ddb758492d8bf4772a0a77e53a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.221528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8ad4099ff6472cb0e0567b942d9c46, user_id=97c7f7ddb758492d8bf4772a0a77e53a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.249823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.266150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 988/1971] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:57 2022] PUT /identity/v3/projects/aa8ad4099ff6472cb0e0567b942d9c46/users/97c7f7ddb758492d8bf4772a0a77e53a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:57.276959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.277264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.277898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.316498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] MFA Rules not processed for user `97c7f7ddb758492d8bf4772a0a77e53a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:57.317664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:57.416474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 984/1972] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:57.420778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.513914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e305e-2aef-49c8-a16a-a7fb19cfea5c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.519633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.520243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.520538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.520822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.521471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.548445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb7784-bbd2-46d0-b1f4-d9d24a8460de admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.590715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 989/1973] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:57 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:57.590942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.596966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.597406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.597905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.598806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca689-a264-4ec0-a145-d3e4a3d76f40 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.649957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] MFA Rules not processed for user `6b94017d79f24adaa76748899bc7c014`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:57.651351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:57.682417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.683235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.683686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.684067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.684812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.713288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.738743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 985/1974] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:57 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:57.742234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.744733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 990/1975] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:57.755048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.756623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:57.761394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2505e23-11e7-43fd-b7bb-77c75ef997e6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.776048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.777705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.778350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.779934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.780868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.821503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.833623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 986/1976] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:57.845643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.856464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33b3f8-87cb-43ab-8868-73399b097593 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.861855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361033-d428-4dbb-9ec0-0a2555a0acac None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:57.866152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.866935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:57.867136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.867702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.868035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:57.868299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.868497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:57.868868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] PATH_INFO: `/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:57.878558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.911917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.925613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 991/1977] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:57 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:57.927580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d020af49d5ed44e69121ee7d010152ad, user_id=ca6839ccc2cd4d03aac43fafd7082ffd, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:57.962415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:57.981310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 987/1978] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:57 2022] PUT /identity/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:57.985975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:57.998272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb32c-bd39-4aa6-a000-70e49254fe0e service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.087074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.087872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.088310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.088711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.089575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.119288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.138712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 992/1979] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:58.141127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.151101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89151805-60b5-49e8-8021-388fe9dbd031 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.155442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.156642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.157100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.157379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] PATH_INFO: `/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.159780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d020af49d5ed44e69121ee7d010152ad, user_id=ca6839ccc2cd4d03aac43fafd7082ffd, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.188508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.201258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 988/1980] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:58 2022] PUT /identity/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:58.205458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.216706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c72bb-29a0-4853-9cec-2c958f59c6c7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.285373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.286060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.286422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.286849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.287631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.314149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f09c5-db16-494b-90f2-01e6acc111d4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.333954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 993/1981] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:58.338139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.351637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4deb9-ec3d-4380-a914-ce2733b72332 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.356833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.358124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.358309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.358701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] PATH_INFO: `/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.361793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d020af49d5ed44e69121ee7d010152ad, user_id=ca6839ccc2cd4d03aac43fafd7082ffd, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.398084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.419340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 989/1982] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:58 2022] PUT /identity/v3/projects/d020af49d5ed44e69121ee7d010152ad/users/ca6839ccc2cd4d03aac43fafd7082ffd/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:58.437151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.437151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.437151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.472265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] MFA Rules not processed for user `ca6839ccc2cd4d03aac43fafd7082ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:58.473518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.558057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 994/1983] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:58 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:58.568840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.635567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44267dc3-b20f-48c0-b079-e537f96bc051 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.639002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.639594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.640138 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.640421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.650229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.676404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53f2a-730f-4614-ba7f-6d131d017ed7 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.686195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 990/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:58.712528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.767279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.767614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.768052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.797109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420b7a3-08af-43f2-9362-a2533d0ed48f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.803174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.804689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.805124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.806848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] PATH_INFO: `/v3/users/97c7f7ddb758492d8bf4772a0a77e53a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.808148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c7f7ddb758492d8bf4772a0a77e53a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:58.813121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] MFA Rules not processed for user `78f74228c62a49059a35c063f53245a6`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:58.815285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.846808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.921518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c7f7ddb758492d8bf4772a0a77e53a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.925819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 991/1985] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:58 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:58.935748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c7f7ddb758492d8bf4772a0a77e53a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.936564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.936681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c7f7ddb758492d8bf4772a0a77e53a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.938275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.938390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c7f7ddb758492d8bf4772a0a77e53a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.952032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106c7c4-0378-40ad-b70e-770247c521df None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.957176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.958080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.958767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.959310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.961375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.971062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dad9cbc7-0017-4944-ad87-714d9f1fce8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c7f7ddb758492d8bf4772a0a77e53a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.003712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 995/1986] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:58 2022] DELETE /identity/v3/users/97c7f7ddb758492d8bf4772a0a77e53a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:59.006709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc5c0-ca26-4462-87d1-72b730f063b5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.006967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc5c0-ca26-4462-87d1-72b730f063b5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.007253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc5c0-ca26-4462-87d1-72b730f063b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.053715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ff8cc5c0-ca26-4462-87d1-72b730f063b5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:59.055015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ff8cc5c0-ca26-4462-87d1-72b730f063b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:59.071601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:59.112025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:59.122714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 992/1987] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:59.130634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 996/1988] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:59.144095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:59.145982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:59.226019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d12ef9-f108-4903-8d8b-88eba1fa8c55 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:59.303802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:59.304476 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.304762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.305042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.314991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:59.348686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:59.372500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 993/1989] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:59.658459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.659249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.659810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.707150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] MFA Rules not processed for user `6b94017d79f24adaa76748899bc7c014`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:59.709426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:59.789892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:59.791322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:59.814588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e45215-06e4-47ee-a837-8482ef900cae service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:59.819759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:59.820713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.821014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.821390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] PATH_INFO: `/v3/projects/aa8ad4099ff6472cb0e0567b942d9c46` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.822639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8ad4099ff6472cb0e0567b942d9c46)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:46:59.851736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 997/1990] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:46:59 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:59.854603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:59.986487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8ad4099ff6472cb0e0567b942d9c46', 'request_id': 'req-c45f3579-029f-43b6-98f4-7172dffbfa56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.007955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8ad4099ff6472cb0e0567b942d9c46', 'request_id': 'req-c45f3579-029f-43b6-98f4-7172dffbfa56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.039940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8ad4099ff6472cb0e0567b942d9c46', 'request_id': 'req-c45f3579-029f-43b6-98f4-7172dffbfa56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.059918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] The token cache is being invalidate because project aa8ad4099ff6472cb0e0567b942d9c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:00.060371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.061023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.066089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 994/1991] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:59 2022] DELETE /identity/v3/projects/aa8ad4099ff6472cb0e0567b942d9c46 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:00.067511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.080032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad923e6-1419-4f86-b75d-8566277d336a None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.150062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.151099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.151751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.152365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] PATH_INFO: `/v3/users/ca6839ccc2cd4d03aac43fafd7082ffd` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.153798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6839ccc2cd4d03aac43fafd7082ffd)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:00.182390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.259369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6839ccc2cd4d03aac43fafd7082ffd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.269670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6839ccc2cd4d03aac43fafd7082ffd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.270438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6839ccc2cd4d03aac43fafd7082ffd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.271155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6839ccc2cd4d03aac43fafd7082ffd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.279886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6839ccc2cd4d03aac43fafd7082ffd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.300778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 998/1992] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:00 2022] DELETE /identity/v3/users/ca6839ccc2cd4d03aac43fafd7082ffd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:00.934763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.936137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.079063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f3579-029f-43b6-98f4-7172dffbfa56 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.194351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.195164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.195583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.196050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.198338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.225847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.228359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.331591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:01.366323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e129-a141-4fe6-9329-ca8cbc9f7994 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.374099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca14e-36fe-4c02-b9fc-b2ff412b1027 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.380089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.381177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.381670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.382105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] PATH_INFO: `/v3/projects/d020af49d5ed44e69121ee7d010152ad` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.383637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d020af49d5ed44e69121ee7d010152ad)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:01.383973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 995/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:00 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:01.415630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.481235 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd020af49d5ed44e69121ee7d010152ad', 'request_id': 'req-bb18e446-2d34-464e-ae05-7ffcaa196604'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:01.487320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd020af49d5ed44e69121ee7d010152ad', 'request_id': 'req-bb18e446-2d34-464e-ae05-7ffcaa196604'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:01.506182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd020af49d5ed44e69121ee7d010152ad', 'request_id': 'req-bb18e446-2d34-464e-ae05-7ffcaa196604'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:01.535296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] The token cache is being invalidate because project d020af49d5ed44e69121ee7d010152ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:01.535594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:01.536305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bb18e446-2d34-464e-ae05-7ffcaa196604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:01.541510 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 999/1994] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:01 2022] DELETE /identity/v3/projects/d020af49d5ed44e69121ee7d010152ad => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:01.543069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.543371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.543709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.572896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:01.574278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.654796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 996/1995] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:01.663969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.664320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.664550 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.688292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:01.689487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.696715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1000/1996] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:01.701049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.711010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb681e9-7dc2-4041-87ce-a5890e1884b2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.715517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.716196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.716496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.716781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.717481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:01.717880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:01.744317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.771640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 997/1997] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:01.773438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.782231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d277-9410-4717-858d-9188d108ba88 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.787629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.788395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.788730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.788956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.789752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:01.820146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.854907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1001/1998] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:01.856533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.868130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3113090-e650-41e6-ad1c-1f25eb6b2c87 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.938015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.938874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.939002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.939196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.939832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:01.966575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.989369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 998/1999] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:01.993451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.003757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88427dc-73c9-456c-81c5-801c2e56711e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.008300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.008900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.009191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.009474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.010325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.036346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8607dd-43b2-4f71-aa23-ab42ef059c52 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.046949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1002/2000] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:02.051207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.061406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608371e1-b80e-4e29-9155-7c34b0bc6dae admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.076060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.077456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.077760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.078053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] PATH_INFO: `/v3/projects/38d10cf370094d55a217df5716f51618/users/a3cef7ff637740ef8c1c56f3223fcb2e/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.104398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d10cf370094d55a217df5716f51618, user_id=a3cef7ff637740ef8c1c56f3223fcb2e, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.131102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.145750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 999/2001] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:02 2022] PUT /identity/v3/projects/38d10cf370094d55a217df5716f51618/users/a3cef7ff637740ef8c1c56f3223fcb2e/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:02.155852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.156201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.156487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.193415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] MFA Rules not processed for user `a3cef7ff637740ef8c1c56f3223fcb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:02.194573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:02.270514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1003/2002] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:02.274998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.342983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe4ed-cb30-492b-b5f9-61f36ad2e71a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.347569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.348161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.348450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.348722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.349371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.376486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.402968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1000/2003] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:02 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:02.407713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.417968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dab46-6d03-420d-a3d5-b6b64046b139 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.480155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.480766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.481061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.481350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.482051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.508896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.527918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1004/2004] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:02 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:02.532065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.541676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ca03-cabd-4a6f-a97e-7bc157f87dd6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.546021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.547220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.547962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.547962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.548613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.574372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.585683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1001/2005] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:02.591136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.600905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e695ed1-d1b7-41aa-97e4-01083022d126 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.605685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.606518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.606888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.607264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] PATH_INFO: `/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.628527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7fc8ffb43b493a9a4c0d7eacdb8250, user_id=9afc46ecaf734be0b332da5d3677a942, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.655710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.670509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1005/2006] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:02 2022] PUT /identity/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:02.675696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.685255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11f175-4490-45c5-ba4a-fd3c7e860312 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.749168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.749846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.750188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.750414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.751166 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.776974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.787941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1002/2007] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:02.791984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.802531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38defaee-c9f7-48cd-9564-016a8454bcf7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.806793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.807614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.807906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.808191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] PATH_INFO: `/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.809945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7fc8ffb43b493a9a4c0d7eacdb8250, user_id=9afc46ecaf734be0b332da5d3677a942, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.836754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.847312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1006/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:02 2022] PUT /identity/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:02.851051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.861065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef35ecd-425c-4c45-8f0d-0ae46cbd79cb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.925293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.926537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.926870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.927159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.927854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:02.953199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691d0f-a603-4c58-827e-a6b4ff3e36ad admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.963974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1003/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:02.967958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.979020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcebe-421e-47b8-8e2c-091d20b87a29 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.984226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.985650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.985940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.986332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] PATH_INFO: `/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.988245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7fc8ffb43b493a9a4c0d7eacdb8250, user_id=9afc46ecaf734be0b332da5d3677a942, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:03.016037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:03.030928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1007/2010] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:02 2022] PUT /identity/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250/users/9afc46ecaf734be0b332da5d3677a942/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:03.041149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:03.041449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:03.041761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:03.078857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] MFA Rules not processed for user `9afc46ecaf734be0b332da5d3677a942`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:03.079945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:03.156049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1004/2011] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:03.166738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:03.168440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:03.236366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b95ef-c459-4880-a676-79ab6a23eb0d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:03.239663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:03.240240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:03.240526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:03.240802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:03.249781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:03.275150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a1bb-7e0f-4577-bea0-48c12e1c6c7c service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:03.284774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1008/2012] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:03 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:03.399218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:03.469812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5ac11-903e-4466-9f15-5c03cbd952d3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:03.473988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:03.474828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:03.475119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:03.475402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] PATH_INFO: `/v3/users/a3cef7ff637740ef8c1c56f3223fcb2e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:03.476492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cef7ff637740ef8c1c56f3223fcb2e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:03.502829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:03.555071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cef7ff637740ef8c1c56f3223fcb2e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:03.566590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cef7ff637740ef8c1c56f3223fcb2e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:03.567245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cef7ff637740ef8c1c56f3223fcb2e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:03.567900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cef7ff637740ef8c1c56f3223fcb2e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:03.575669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cef7ff637740ef8c1c56f3223fcb2e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:03.587668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1005/2013] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:03 2022] DELETE /identity/v3/users/a3cef7ff637740ef8c1c56f3223fcb2e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:03.592120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:03.592414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:03.592691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:03.616009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:03.617369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:03.681491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1009/2014] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:03.692018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:03.693386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:03.757309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c557-c055-4db2-b3cb-bed3cf84f534 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:03.760622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:03.761362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:03.761489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:03.761766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:03.771149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:03.799290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:03.809154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1006/2015] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:04.262864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:04.264567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:04.277855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aca08-790c-45b6-90c2-2c327af156d3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:04.283016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:04.283810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:04.284092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:04.284370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] PATH_INFO: `/v3/projects/38d10cf370094d55a217df5716f51618` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:04.285449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d10cf370094d55a217df5716f51618)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:04.313895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:04.366338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d10cf370094d55a217df5716f51618', 'request_id': 'req-8cfc98d2-6425-4789-94f1-9702c2b20e05'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.371528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d10cf370094d55a217df5716f51618', 'request_id': 'req-8cfc98d2-6425-4789-94f1-9702c2b20e05'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.383411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d10cf370094d55a217df5716f51618', 'request_id': 'req-8cfc98d2-6425-4789-94f1-9702c2b20e05'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.395995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] The token cache is being invalidate because project 38d10cf370094d55a217df5716f51618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:04.396400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.396995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.398436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1010/2016] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:04 2022] DELETE /identity/v3/projects/38d10cf370094d55a217df5716f51618 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:04.402507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:04.416773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2dbf2-070b-4b2c-840f-bf0c191db04a service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:04.478152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:04.478985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:04.479278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:04.479582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] PATH_INFO: `/v3/users/9afc46ecaf734be0b332da5d3677a942` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:04.480680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afc46ecaf734be0b332da5d3677a942)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:04.506857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:04.560291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afc46ecaf734be0b332da5d3677a942'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.575034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afc46ecaf734be0b332da5d3677a942'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.575725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afc46ecaf734be0b332da5d3677a942'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.576307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afc46ecaf734be0b332da5d3677a942'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.584692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b792e8cb-0a6c-4c8d-bb17-dc2742b5d987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afc46ecaf734be0b332da5d3677a942'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:04.597783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1007/2017] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:04 2022] DELETE /identity/v3/users/9afc46ecaf734be0b332da5d3677a942 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:05.192544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.198503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:05.216359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc98d2-6425-4789-94f1-9702c2b20e05 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.291887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.292741 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.293029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.293310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] PATH_INFO: `/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.295624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7fc8ffb43b493a9a4c0d7eacdb8250)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.324640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:05.383520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7fc8ffb43b493a9a4c0d7eacdb8250', 'request_id': 'req-456d8718-84a3-40ed-adbb-c215c0a30235'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:05.389307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7fc8ffb43b493a9a4c0d7eacdb8250', 'request_id': 'req-456d8718-84a3-40ed-adbb-c215c0a30235'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:05.402293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7fc8ffb43b493a9a4c0d7eacdb8250', 'request_id': 'req-456d8718-84a3-40ed-adbb-c215c0a30235'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:05.422136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] The token cache is being invalidate because project 4b7fc8ffb43b493a9a4c0d7eacdb8250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:05.422694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:05.423525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-456d8718-84a3-40ed-adbb-c215c0a30235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:05.428151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1011/2018] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:05 2022] DELETE /identity/v3/projects/4b7fc8ffb43b493a9a4c0d7eacdb8250 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:05.432588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.433044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.433149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.458772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:05.460203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:05.533637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1008/2019] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:05.541199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.541494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.542234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.564045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:05.565224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:05.572733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1012/2020] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:05.577096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.586939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d658885-7b1d-43a4-b4f8-014d1bcb5ac0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.591242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.591839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.592132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.592417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.593111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:05.594019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.619327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:05.632683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1009/2021] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:47:05.637206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.646925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca8c1d-a3e5-498e-94cc-b98e50df2d91 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.651178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.651771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.652056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.652336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.652981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.679412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:05.708133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1013/2022] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:05 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:05.712386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.724592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7a07f-e37a-4de3-9ef0-4212e6f36045 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.793945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.794564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.794912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.795163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.795832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.822696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:05.846793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1010/2023] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:05 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:05.849470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.861603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384520-64d1-46b5-a578-22e56a5c5431 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.867444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.869613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.870187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.870629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.872198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.901343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc302324-1281-4720-af3b-5c9ca51ac81b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:05.915441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1014/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:05.916715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:05.927918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765b8f2-9510-4e24-be25-47fd413e7f05 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:05.933638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:05.934491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:05.934814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:05.935095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] PATH_INFO: `/v3/projects/df6f68d6beb54fa6a1b14b546b5dec31/users/b04fe24c329444919adbe1f0155dad5d/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:05.960414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6f68d6beb54fa6a1b14b546b5dec31, user_id=b04fe24c329444919adbe1f0155dad5d, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:05.994082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.008967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1011/2025] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:05 2022] PUT /identity/v3/projects/df6f68d6beb54fa6a1b14b546b5dec31/users/b04fe24c329444919adbe1f0155dad5d/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:06.020666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.020967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.021317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.061926 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] MFA Rules not processed for user `b04fe24c329444919adbe1f0155dad5d`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:06.063183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:06.134140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1015/2026] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:06 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:06.138566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.208728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcf7f-a1fd-47f1-8ad3-3f43e49db73d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.213234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.214320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.214320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.214771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.215403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.242277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.271962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1012/2027] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:06 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:06.276377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.288813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17367a-4a7a-4056-b749-b3a7d7944d39 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.356936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.357669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.357827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.358290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.359681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.386581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.409660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1016/2028] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:06 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:06.416058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.426759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c58136-d179-412f-87c2-fc04d1815598 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.431310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.431909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.432200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.432483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.433186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.460143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.475345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1013/2029] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:06.476483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.488781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243ee3-77a0-4cba-b091-759d4a57f976 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.493171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.494020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.494285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.494564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] PATH_INFO: `/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.517508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46d81b78964c14ab1efb3f68308e75, user_id=8a2b938a60604351a23b0d4b561878f4, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.556507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.572386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1017/2030] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:06 2022] PUT /identity/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:06.576088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.587456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66399c6-d4e4-484f-aff1-7a3a2b533ede admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.662800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.663537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.663827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.664107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.665241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.691192 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.701617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1014/2031] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:06.705868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.716096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab3a2-2aa9-4020-9f49-136e82e0a635 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.721344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.722170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.722463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.722779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] PATH_INFO: `/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.724592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46d81b78964c14ab1efb3f68308e75, user_id=8a2b938a60604351a23b0d4b561878f4, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.751826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.762301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1018/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:06 2022] PUT /identity/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:06.766412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.776003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b65f-5cb3-4466-a7b9-d866f94d4567 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.842317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.842951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.843279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.844253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.845006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.870464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526b87b-1e50-44fb-97d6-0420fe94a103 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.881486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1015/2033] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:06.885788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.897030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672dd28-0d6d-470b-9c93-f56f930b7638 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.901176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.901991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.902278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.902557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] PATH_INFO: `/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.904553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46d81b78964c14ab1efb3f68308e75, user_id=8a2b938a60604351a23b0d4b561878f4, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:06.937814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.957448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1019/2034] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:06 2022] PUT /identity/v3/projects/fb46d81b78964c14ab1efb3f68308e75/users/8a2b938a60604351a23b0d4b561878f4/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:06.969101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.969474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.969666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.019485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] MFA Rules not processed for user `8a2b938a60604351a23b0d4b561878f4`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:07.020958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:07.125520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1016/2035] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:06 2022] POST /identity/v3/auth/tokens => generated 3741 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:07.136054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:07.137542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:07.215743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81edfcc-3012-42b2-b51e-145719e2aa3f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:07.221243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:07.221955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:07.222250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:07.222533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.233040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:07.261099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:07.272182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1020/2036] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:07 2022] GET /identity/v3/auth/tokens => generated 3741 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:07.387101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:07.396913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a04e-8852-4272-aa3f-6b7f5bd74a5d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:07.400219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:07.400786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:07.401074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:07.401353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.465702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:07.492469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c973-6ce4-4658-a5bb-70e918d6bff6 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:07.501894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1017/2037] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:07 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:18.454353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:18.522818 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24197fd0-d74d-4939-81dc-33273d30d788 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:18.526922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:18.527716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:18.528003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:18.528284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] PATH_INFO: `/v3/users/b04fe24c329444919adbe1f0155dad5d` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:18.529355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04fe24c329444919adbe1f0155dad5d)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:18.555377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:18.605661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04fe24c329444919adbe1f0155dad5d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:18.612483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04fe24c329444919adbe1f0155dad5d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:18.613066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04fe24c329444919adbe1f0155dad5d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:18.613633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04fe24c329444919adbe1f0155dad5d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:18.623292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04fe24c329444919adbe1f0155dad5d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:18.642464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1021/2038] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:18 2022] DELETE /identity/v3/users/b04fe24c329444919adbe1f0155dad5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:18.647170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:18.647653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:18.647799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:18.671821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:18.673080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:18.888858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1018/2039] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:18.902537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:18.903834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:19.046596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b8247-3650-4dd9-8778-0067dc248db9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:19.063049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:19.063722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:19.064076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:19.064481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:19.076081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:19.139268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:19.168961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1022/2040] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:19.618843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:19.620181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:19.632197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59009e15-df9f-43e1-8112-a0d372779512 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:19.636422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:19.637209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:19.637485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:19.637871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] PATH_INFO: `/v3/projects/df6f68d6beb54fa6a1b14b546b5dec31` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:19.639052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6f68d6beb54fa6a1b14b546b5dec31)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:19.666736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:19.716040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6f68d6beb54fa6a1b14b546b5dec31', 'request_id': 'req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.724076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6f68d6beb54fa6a1b14b546b5dec31', 'request_id': 'req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.734964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6f68d6beb54fa6a1b14b546b5dec31', 'request_id': 'req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.744421 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] The token cache is being invalidate because project df6f68d6beb54fa6a1b14b546b5dec31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:19.744729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.745331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.746750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1019/2041] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:19 2022] DELETE /identity/v3/projects/df6f68d6beb54fa6a1b14b546b5dec31 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:19.750739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:19.759684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dda4e6-7a62-4959-bcf5-225ef6a459a4 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:19.823329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:19.824124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:19.824411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:19.824690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] PATH_INFO: `/v3/users/8a2b938a60604351a23b0d4b561878f4` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:19.825863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2b938a60604351a23b0d4b561878f4)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:19.852999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:19.903381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2b938a60604351a23b0d4b561878f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.911397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2b938a60604351a23b0d4b561878f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.912017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2b938a60604351a23b0d4b561878f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.912771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2b938a60604351a23b0d4b561878f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.920906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-98c65b0c-700e-453c-811b-407491f7aa5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2b938a60604351a23b0d4b561878f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:19.939287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1023/2042] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:19 2022] DELETE /identity/v3/users/8a2b938a60604351a23b0d4b561878f4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:20.540636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:20.543363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:20.555835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe119e1-b4b3-4d00-9dcd-bd15e816f61a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:20.625203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:20.625995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:20.626283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:20.626568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] PATH_INFO: `/v3/projects/fb46d81b78964c14ab1efb3f68308e75` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:20.627702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb46d81b78964c14ab1efb3f68308e75)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:20.658073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:20.725223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb46d81b78964c14ab1efb3f68308e75', 'request_id': 'req-fac866f0-1eea-40fd-b63c-6a6593a68d4a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:20.736553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb46d81b78964c14ab1efb3f68308e75', 'request_id': 'req-fac866f0-1eea-40fd-b63c-6a6593a68d4a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:20.750944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb46d81b78964c14ab1efb3f68308e75', 'request_id': 'req-fac866f0-1eea-40fd-b63c-6a6593a68d4a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:20.763040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] The token cache is being invalidate because project fb46d81b78964c14ab1efb3f68308e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:20.763456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:20.767154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fac866f0-1eea-40fd-b63c-6a6593a68d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:20.768890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1020/2043] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:20 2022] DELETE /identity/v3/projects/fb46d81b78964c14ab1efb3f68308e75 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:20.774970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:20.775426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:20.775634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:20.800877 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:20.802060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:20.886814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1024/2044] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:20.888522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:20.888823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:20.889112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:20.918173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:20.919392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:20.928148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1021/2045] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:20.932420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:20.941927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b485bfa-9df8-4cca-a354-88ba39b24f8f None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:20.946154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:20.946768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:20.947059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:20.947338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:20.948036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:20.948335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:20.974136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:20.989429 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1025/2046] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:47:20.993542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.004296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8167c7-93e4-4b37-b50c-13bfcdd8e48f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.008917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.009611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.009977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.010358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.011105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.040043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.067555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1022/2047] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:20 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:21.072116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.082382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4026b-e7c5-4a68-8c3f-c78bd9ffd87f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.145893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.146538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.146817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.147101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.147738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.173905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.192621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1026/2048] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:21 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:21.196697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.207133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2fb55-8c6c-4e49-b570-b14d0a1516fe admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.211431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.212095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.212451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.212810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.213665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.240095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd838a96-0f91-429f-83a0-0ae5c74c3e87 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.250965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1023/2049] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:21.255277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.265907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d24bf-5560-4ce0-89e8-a8215ce532c7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.270186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.271043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.271331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.271611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] PATH_INFO: `/v3/projects/ad86ad2916bd4f6492f8795347c11cc1/users/a5721afb241e421ebd94e68f9e66239d/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.293796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad86ad2916bd4f6492f8795347c11cc1, user_id=a5721afb241e421ebd94e68f9e66239d, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.321157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.333866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1027/2050] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:21 2022] PUT /identity/v3/projects/ad86ad2916bd4f6492f8795347c11cc1/users/a5721afb241e421ebd94e68f9e66239d/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:21.344626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751977ea-441f-4046-bb0c-303792e44098 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.344918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751977ea-441f-4046-bb0c-303792e44098 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.345201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751977ea-441f-4046-bb0c-303792e44098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.381677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-751977ea-441f-4046-bb0c-303792e44098 None None] MFA Rules not processed for user `a5721afb241e421ebd94e68f9e66239d`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:21.382859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-751977ea-441f-4046-bb0c-303792e44098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:21.457611 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1024/2051] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:21 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:21.462139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.535319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f06a-f2a3-4674-8fa5-561bf7978430 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.539849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.540455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.540825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.541150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.541805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.571365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.604801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1028/2052] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:21 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:21.609486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751977ea-441f-4046-bb0c-303792e44098 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.621102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751977ea-441f-4046-bb0c-303792e44098 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.699863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.700539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.700835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.701216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.701932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.728884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.753434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1025/2053] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:21 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:21.754555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.765625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff27f8-60e3-4d4c-b915-fe5c2be62d7e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.769030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.769626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.769921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.770202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.770940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.800432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39786f8-59fd-437e-a000-4979b5e335d5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.812663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1029/2054] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:21.816671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:21.828530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5b73-df12-456c-b8cf-39fd18f85756 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:21.833498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:21.834808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.835267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.835706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] PATH_INFO: `/v3/projects/b0f5f48c589c40018b314826ed230cd0/users/e46a648df16a4eecac5e711d55d047c9/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.860764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5f48c589c40018b314826ed230cd0, user_id=e46a648df16a4eecac5e711d55d047c9, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:21.893324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:21.908658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1026/2055] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:21 2022] PUT /identity/v3/projects/b0f5f48c589c40018b314826ed230cd0/users/e46a648df16a4eecac5e711d55d047c9/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:21.919551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:21.919846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:21.920132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:21.962978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] MFA Rules not processed for user `e46a648df16a4eecac5e711d55d047c9`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:21.964790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:22.050006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1030/2056] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:21 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:22.054403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.142785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c990-a277-4792-a865-aa94829779d2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.148377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.149425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.149425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.149667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.150506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.177832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.218733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1027/2057] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:22.222817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.237634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b94c6-0992-43ce-9033-c4e5ffd594b2 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.303023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.303630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.303922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.304421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.305115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.332077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.353232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1031/2058] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:22 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:22.357305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.368347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dfe08-04cb-473e-8570-8a9028b1840c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.375075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.375601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.375891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.376351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.377060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.411395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.423146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1028/2059] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:22.427302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.438442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f9c3-20fe-443e-a807-de6fe737362d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.443009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.443851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.444140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.444423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] PATH_INFO: `/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.465260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5169236a87504a4e998db6696d76b1db, user_id=0460798c8ffd4763a9db905c9c84da61, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.492414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.505523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1032/2060] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:22 2022] PUT /identity/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:22.509600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.520058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2ba6-564b-4b4e-9540-a1f497327ffb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.584424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.585029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.585324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.585605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.586325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.613903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.625838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1029/2061] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:22.629865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.641010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236d60-d1e4-497d-acb2-40514297f401 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.646001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.646954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.647251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.647541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] PATH_INFO: `/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.649331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5169236a87504a4e998db6696d76b1db, user_id=0460798c8ffd4763a9db905c9c84da61, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.678039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.689162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1033/2062] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:22 2022] PUT /identity/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:22.693328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.704459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb999a-3990-4faa-8552-2e79c88c5ed5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.784997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.786337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.786815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.787099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.787805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.813883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54824-5d35-4ce6-be4b-4197d936b5c0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.825343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1030/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:22.830862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:22.840645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d1b3-7870-43b8-a97a-d6926f92e960 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:22.845240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:22.846052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.846376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.846641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] PATH_INFO: `/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.848451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5169236a87504a4e998db6696d76b1db, user_id=0460798c8ffd4763a9db905c9c84da61, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:22.876211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:22.890899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1034/2064] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:22 2022] PUT /identity/v3/projects/5169236a87504a4e998db6696d76b1db/users/0460798c8ffd4763a9db905c9c84da61/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:22.901353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:22.901648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:22.901939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:22.944122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] MFA Rules not processed for user `0460798c8ffd4763a9db905c9c84da61`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:22.945197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:23.102831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1031/2065] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:22 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:23.113825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:23.115506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:23.185280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758719c-109f-4fe0-9759-8548da729b94 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:23.188916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:23.189383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:23.189668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:23.189943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:23.269731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:23.301187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2a2e4-c680-4635-bf59-2df8eb0f6d4f service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:23.305810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1035/2066] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:23 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:23.977466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:23.979520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:24.059314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541827e-d81d-4489-bc86-17dd515f3991 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:24.063636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:24.064436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:24.064722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:24.064998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] PATH_INFO: `/v3/users/1c4aa0c9e552433fa84159d2ee79d342` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:24.066080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4aa0c9e552433fa84159d2ee79d342)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:24.094942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:24.143641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4aa0c9e552433fa84159d2ee79d342'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.155114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4aa0c9e552433fa84159d2ee79d342'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.156236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4aa0c9e552433fa84159d2ee79d342'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.156815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4aa0c9e552433fa84159d2ee79d342'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.164325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4aa0c9e552433fa84159d2ee79d342'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.179630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1032/2067] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:23 2022] DELETE /identity/v3/users/1c4aa0c9e552433fa84159d2ee79d342 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:24.184170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:24.184644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:24.184734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:24.208091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:24.209247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:24.273637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1036/2068] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:24.284501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:24.286423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:24.355968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8052a-4a4c-42dc-8b11-d6e4b008dc9c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:24.359553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:24.360189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:24.360482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:24.360766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:24.370043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:24.396002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d065-820a-4722-b17b-b1a34da20979 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:24.406333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1033/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:24.802696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:24.804210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:24.817814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92decf-6d76-4b7e-a6d2-5778ca4abd75 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:24.823430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:24.824226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:24.824507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:24.824962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] PATH_INFO: `/v3/projects/dc8bed25ca5d4714930c78da7a2ece75` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:24.826065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8bed25ca5d4714930c78da7a2ece75)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:24.856696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:24.909161 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8bed25ca5d4714930c78da7a2ece75', 'request_id': 'req-bcb0779e-40a8-44dd-9993-d692c5c51884'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.914341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8bed25ca5d4714930c78da7a2ece75', 'request_id': 'req-bcb0779e-40a8-44dd-9993-d692c5c51884'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.925605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8bed25ca5d4714930c78da7a2ece75', 'request_id': 'req-bcb0779e-40a8-44dd-9993-d692c5c51884'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.944584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] The token cache is being invalidate because project dc8bed25ca5d4714930c78da7a2ece75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:24.945020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.945760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bcb0779e-40a8-44dd-9993-d692c5c51884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:24.947831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1037/2070] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:24 2022] DELETE /identity/v3/projects/dc8bed25ca5d4714930c78da7a2ece75 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:24.953293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:24.953890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:24.954361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.002288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:25.005276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.102213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1034/2071] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:25.110128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.110717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.111046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.140914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:25.142606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.146051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.147487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.151274 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1038/2072] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:25.155414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.165434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9e9c-21dc-4924-a850-97e6ae2b668b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.169917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.170506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.171513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.171947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.172646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:25.172942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.201708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.219847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1039/2073] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:47:25.224671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.236061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b16d4d-7a00-4072-bcb7-833d07ef6346 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.236355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985e5df-dee1-425d-bcf8-db0ec191f371 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.240139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.240272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.240738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.240862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.241012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.241134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.241292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.241403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.242017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.242997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.269286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f03080-1916-4d18-8bac-3c1136aa76a3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.297808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1040/2074] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:25 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:25.300730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.301022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.301491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.309870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.326619 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] MFA Rules not processed for user `153666ecd9c84936bd1c9ce32373ca27`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:25.328755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.336271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.346154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1035/2075] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:25 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:47:25.347259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.357030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdbf8e-9f13-4525-99dd-e881dea53a53 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.451441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.451673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.452509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.452914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.453487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.487566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.492473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1041/2076] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:25 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:25.509851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1036/2077] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:25 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:25.515584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.526468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23086f0d-c74a-4004-b250-9c7e847903dd None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.534764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.535463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.535830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.536119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.537532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.563245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cc31a-e9e8-4497-8ad8-544c189813f8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.574427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1042/2078] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:25.578924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.590972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff12923-54f1-4516-9b5e-b8091ca02722 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.595805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.596707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.597071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.597420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] PATH_INFO: `/v3/projects/6e020aa62daf451494acf416fae6e502/users/39261ec9dd3d4ccc919f3474e8bebc5a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.619549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e020aa62daf451494acf416fae6e502, user_id=39261ec9dd3d4ccc919f3474e8bebc5a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.649064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.664366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1037/2079] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:25 2022] PUT /identity/v3/projects/6e020aa62daf451494acf416fae6e502/users/39261ec9dd3d4ccc919f3474e8bebc5a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:25.676003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.676302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.676593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.726160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] MFA Rules not processed for user `39261ec9dd3d4ccc919f3474e8bebc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:25.727409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.805771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1043/2080] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:25 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:25.817970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:25.820045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:25.901821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf4ce4-890a-4d78-b26e-4882e7465520 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:25.906745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:25.907271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:25.907646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:25.907912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:25.918237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:25.944837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:25.954429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1038/2081] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:25 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:26.508461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:26.509934 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:26.616006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e953-ebd9-4b15-8798-fa11da3b63b8 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:26.628658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:26.629268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:26.629561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:26.629838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:26.633337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:26.795048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:26.831031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:26.846069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1044/2082] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:26 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:31.244584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:31.246111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:31.323218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e66ad-b689-4ada-a105-11537a4189f7 service glance] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:31.328683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:31.329517 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:31.329790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:31.330080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] PATH_INFO: `/v3/users/6e3c9f1718ca42b7bbb958337cf6f8d3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:31.331296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3c9f1718ca42b7bbb958337cf6f8d3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:31.358938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:31.419394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3c9f1718ca42b7bbb958337cf6f8d3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.435031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3c9f1718ca42b7bbb958337cf6f8d3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.435735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3c9f1718ca42b7bbb958337cf6f8d3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.437045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3c9f1718ca42b7bbb958337cf6f8d3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.447011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3c9f1718ca42b7bbb958337cf6f8d3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.463194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1039/2083] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:31 2022] DELETE /identity/v3/users/6e3c9f1718ca42b7bbb958337cf6f8d3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:31.627392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:31.628807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:31.641435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1425-65fd-4412-9f02-49173865df73 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:31.719703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:31.720509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:31.720796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:31.721503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] PATH_INFO: `/v3/users/a5721afb241e421ebd94e68f9e66239d` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:31.722173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5721afb241e421ebd94e68f9e66239d)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:31.752325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:31.828722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5721afb241e421ebd94e68f9e66239d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.838132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5721afb241e421ebd94e68f9e66239d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.838911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5721afb241e421ebd94e68f9e66239d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.843010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5721afb241e421ebd94e68f9e66239d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.844368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:31.845796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:31.852426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f09d3a7b-3f4c-40e1-b3ba-698fff55e1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5721afb241e421ebd94e68f9e66239d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.859975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851109f-f31f-4a71-aea2-10c1ff5a85c8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:31.864824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:31.865688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:31.866049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:31.866399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] PATH_INFO: `/v3/projects/a74b6451e87d4ef8a1338608ea90e7cc` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:31.867703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74b6451e87d4ef8a1338608ea90e7cc)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:31.885069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1045/2084] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:31 2022] DELETE /identity/v3/users/a5721afb241e421ebd94e68f9e66239d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:31.890263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:31.890984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:31.890984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:31.896732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:31.913021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:31.914539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:31.959649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74b6451e87d4ef8a1338608ea90e7cc', 'request_id': 'req-d707db30-e16b-4f91-b66d-8a6f0536739f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.968915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74b6451e87d4ef8a1338608ea90e7cc', 'request_id': 'req-d707db30-e16b-4f91-b66d-8a6f0536739f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.980801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74b6451e87d4ef8a1338608ea90e7cc', 'request_id': 'req-d707db30-e16b-4f91-b66d-8a6f0536739f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:31.986635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1046/2085] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:31.997628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:31.999553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.001289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] The token cache is being invalidate because project a74b6451e87d4ef8a1338608ea90e7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:32.001763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.002584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.004978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1040/2086] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:31 2022] DELETE /identity/v3/projects/a74b6451e87d4ef8a1338608ea90e7cc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:32.008552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:32.010483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.065507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc026033-884c-43ae-bdb4-ec37e39b5e2b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:32.085151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707db30-e16b-4f91-b66d-8a6f0536739f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:32.089452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:32.090261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.090553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.090863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] PATH_INFO: `/v3/users/78f74228c62a49059a35c063f53245a6` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.095438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f74228c62a49059a35c063f53245a6)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:32.122989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:32.123205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:32.124171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.124465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.124751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.127461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.140367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:32.168215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:32.180162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1047/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:47:32.193567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f74228c62a49059a35c063f53245a6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.205366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f74228c62a49059a35c063f53245a6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.206455 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f74228c62a49059a35c063f53245a6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.207070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f74228c62a49059a35c063f53245a6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.216512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f74228c62a49059a35c063f53245a6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.230767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1041/2088] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:32 2022] DELETE /identity/v3/users/78f74228c62a49059a35c063f53245a6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:32.632865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:32.643603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2186-e419-4568-af36-746203bbbf41 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:32.690858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:32.692278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.727562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:32.728355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.728643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.728925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] PATH_INFO: `/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.729997 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2e6cf4e81343d5b7ffbefd35b39248)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:32.756221 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:32.771508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb52129-ac30-4d2a-a61c-4629d32d1990 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:32.775772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:32.776567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.776855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.777133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] PATH_INFO: `/v3/projects/ad86ad2916bd4f6492f8795347c11cc1` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.778410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad86ad2916bd4f6492f8795347c11cc1)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:32.805730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:32.809307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2e6cf4e81343d5b7ffbefd35b39248', 'request_id': 'req-b64742aa-3cff-4a7a-840a-62540abdd222'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.814775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2e6cf4e81343d5b7ffbefd35b39248', 'request_id': 'req-b64742aa-3cff-4a7a-840a-62540abdd222'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.827967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2e6cf4e81343d5b7ffbefd35b39248', 'request_id': 'req-b64742aa-3cff-4a7a-840a-62540abdd222'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.844192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] The token cache is being invalidate because project 5e2e6cf4e81343d5b7ffbefd35b39248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:32.844577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.845875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b64742aa-3cff-4a7a-840a-62540abdd222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.851098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1048/2089] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:32 2022] DELETE /identity/v3/projects/5e2e6cf4e81343d5b7ffbefd35b39248 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:32.854301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897db5f-571c-4304-9dbe-98d950ce32fe None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.854945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897db5f-571c-4304-9dbe-98d950ce32fe None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.855226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897db5f-571c-4304-9dbe-98d950ce32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.868600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad86ad2916bd4f6492f8795347c11cc1', 'request_id': 'req-a7277457-962d-433e-b238-37437c84fdb0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.879631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad86ad2916bd4f6492f8795347c11cc1', 'request_id': 'req-a7277457-962d-433e-b238-37437c84fdb0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.880258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a897db5f-571c-4304-9dbe-98d950ce32fe None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:32.881535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a897db5f-571c-4304-9dbe-98d950ce32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.894885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad86ad2916bd4f6492f8795347c11cc1', 'request_id': 'req-a7277457-962d-433e-b238-37437c84fdb0'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.906601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] The token cache is being invalidate because project ad86ad2916bd4f6492f8795347c11cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:32.906943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.907564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:32.909401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1042/2090] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:32 2022] DELETE /identity/v3/projects/ad86ad2916bd4f6492f8795347c11cc1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:32.913073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:32.914337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:32.959438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1049/2091] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:32.968522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:32.968829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:32.969116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:32.994954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277457-962d-433e-b238-37437c84fdb0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.001094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.002271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.002611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:33.002996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.003454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] PATH_INFO: `/v3/users/e46a648df16a4eecac5e711d55d047c9` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.005858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46a648df16a4eecac5e711d55d047c9)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.006699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.022764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1050/2092] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:33.023788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.037371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.040220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7859-749b-4114-a808-be2d1ced9e23 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.044713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.045358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.046142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.046423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.047149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:33.047447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.075925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.090540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1051/2093] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:33.094882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.104553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b03138-f01a-4065-9071-b58f074ee30b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.105221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46a648df16a4eecac5e711d55d047c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.109586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.110169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.110454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.110767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.111408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.118325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46a648df16a4eecac5e711d55d047c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.119119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46a648df16a4eecac5e711d55d047c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.119776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46a648df16a4eecac5e711d55d047c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.128246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46a648df16a4eecac5e711d55d047c9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.138420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.140680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1043/2094] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:32 2022] DELETE /identity/v3/users/e46a648df16a4eecac5e711d55d047c9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:33.168765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1052/2095] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:33 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:33.176616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.179156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.267022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1718-67ad-4ac1-88a2-aa3f678197f2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.334646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.335371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.335666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.335947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.336833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.365238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.386065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1044/2096] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:33 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:33.391162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.401070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b697af-f919-4296-ab2f-985141640b64 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.405640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.406270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.406694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.407108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.407814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.435695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.446905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1053/2097] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:33.450911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.460653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97740-d661-4fde-8b0f-9f9eb7f099bd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.464964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.465778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.466066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.466346 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] PATH_INFO: `/v3/projects/db572e1f3af54c2ea3b4b799c7ac481b/users/8634a28bd5e0469b86a4cc2750090583/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.487126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db572e1f3af54c2ea3b4b799c7ac481b, user_id=8634a28bd5e0469b86a4cc2750090583, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.517108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb1294-e160-4027-91a2-510336df59e7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.539929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1045/2098] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:33 2022] PUT /identity/v3/projects/db572e1f3af54c2ea3b4b799c7ac481b/users/8634a28bd5e0469b86a4cc2750090583/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:33.549701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.551644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.552463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.553528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.554235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.563887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889cb32-bc55-4190-902b-0b25230fde72 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.594262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] MFA Rules not processed for user `8634a28bd5e0469b86a4cc2750090583`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:33.595468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.637402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.638209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.638502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.638825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] PATH_INFO: `/v3/projects/b0f5f48c589c40018b314826ed230cd0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.640580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f5f48c589c40018b314826ed230cd0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.667250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.669350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1046/2099] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:33 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:33.679090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.680368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.722371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f5f48c589c40018b314826ed230cd0', 'request_id': 'req-b0b62d80-e601-49de-80f8-de5b456a9e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.727647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f5f48c589c40018b314826ed230cd0', 'request_id': 'req-b0b62d80-e601-49de-80f8-de5b456a9e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.739908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f5f48c589c40018b314826ed230cd0', 'request_id': 'req-b0b62d80-e601-49de-80f8-de5b456a9e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.746050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f8e02-ef19-409c-9691-8cc8d804dce0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.763782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] The token cache is being invalidate because project b0f5f48c589c40018b314826ed230cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:33.764267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.765850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.767347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1054/2100] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:33 2022] DELETE /identity/v3/projects/b0f5f48c589c40018b314826ed230cd0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:33.771234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:33.772533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.810314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.811443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.811831 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.812277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.814235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:33.849761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b62d80-e601-49de-80f8-de5b456a9e09 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:33.853963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:33.854789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:33.855122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:33.855399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] PATH_INFO: `/v3/users/0460798c8ffd4763a9db905c9c84da61` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:33.856487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0460798c8ffd4763a9db905c9c84da61)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.882515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.885263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:33.911914 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:33.922340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1047/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:33 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:47:33.933680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0460798c8ffd4763a9db905c9c84da61'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.942747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0460798c8ffd4763a9db905c9c84da61'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.943535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0460798c8ffd4763a9db905c9c84da61'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.944152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0460798c8ffd4763a9db905c9c84da61'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.953275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0460798c8ffd4763a9db905c9c84da61'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:33.973348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1055/2102] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:33 2022] DELETE /identity/v3/users/0460798c8ffd4763a9db905c9c84da61 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:34.509789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:34.522446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1e76-05a7-4117-982f-78f67a5d3199 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:34.593623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:34.594408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:34.594720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:34.595006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] PATH_INFO: `/v3/projects/5169236a87504a4e998db6696d76b1db` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:34.596082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5169236a87504a4e998db6696d76b1db)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:34.621589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:34.676505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5169236a87504a4e998db6696d76b1db', 'request_id': 'req-14451280-8f47-4414-8fd0-7abafd0bc5e6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:34.683711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5169236a87504a4e998db6696d76b1db', 'request_id': 'req-14451280-8f47-4414-8fd0-7abafd0bc5e6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:34.696039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5169236a87504a4e998db6696d76b1db', 'request_id': 'req-14451280-8f47-4414-8fd0-7abafd0bc5e6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:34.706640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] The token cache is being invalidate because project 5169236a87504a4e998db6696d76b1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:34.707025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:34.707634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-14451280-8f47-4414-8fd0-7abafd0bc5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:34.709057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1048/2103] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:34 2022] DELETE /identity/v3/projects/5169236a87504a4e998db6696d76b1db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:37.603915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:37.605498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:37.618369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4f55-c89a-4c60-9225-0d4ed5e0f520 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:37.699329 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:37.702711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:37.702970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:37.703271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] PATH_INFO: `/v3/users/8634a28bd5e0469b86a4cc2750090583` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:37.704830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8634a28bd5e0469b86a4cc2750090583)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:37.731957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:37.795098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8634a28bd5e0469b86a4cc2750090583'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:37.802710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8634a28bd5e0469b86a4cc2750090583'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:37.803461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8634a28bd5e0469b86a4cc2750090583'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:37.804048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8634a28bd5e0469b86a4cc2750090583'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:37.818121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8634a28bd5e0469b86a4cc2750090583'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:37.839574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1056/2104] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:37 2022] DELETE /identity/v3/users/8634a28bd5e0469b86a4cc2750090583 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:37.845506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:37.845506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:37.846112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:37.868604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:37.869752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:37.940665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1049/2105] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:37.951825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:37.954191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.034813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c3722-cac1-4002-8300-627ddc14d656 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:38.038295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:38.038915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.039210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.039495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.050006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:38.075840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f54ce5-744d-40ca-826e-4916bfbef463 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:38.086036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1057/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:38.505370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:38.506811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.520294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5155a-11ed-49ee-9d1f-438d57ecabf8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:38.524678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:38.525472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.525763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.526148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] PATH_INFO: `/v3/projects/db572e1f3af54c2ea3b4b799c7ac481b` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.527852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db572e1f3af54c2ea3b4b799c7ac481b)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:38.554586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:38.605607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db572e1f3af54c2ea3b4b799c7ac481b', 'request_id': 'req-96126b45-2388-493b-8e35-39fc28f5d95c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:38.612706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db572e1f3af54c2ea3b4b799c7ac481b', 'request_id': 'req-96126b45-2388-493b-8e35-39fc28f5d95c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:38.629057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db572e1f3af54c2ea3b4b799c7ac481b', 'request_id': 'req-96126b45-2388-493b-8e35-39fc28f5d95c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:38.639850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] The token cache is being invalidate because project db572e1f3af54c2ea3b4b799c7ac481b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:38.640252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:38.640847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-96126b45-2388-493b-8e35-39fc28f5d95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:38.642325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1050/2107] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:38 2022] DELETE /identity/v3/projects/db572e1f3af54c2ea3b4b799c7ac481b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:38.647081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.647569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.647781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.671814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:38.672961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.739757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1058/2108] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:38.747376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.747739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.748010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.764079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:38.765748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.770924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:38.772040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.785814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1051/2109] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:38.789929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:38.799196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8ba67-c9be-4e53-a499-306ac053fce5 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:38.803370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:38.803943 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.804231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.804511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.805195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:38.805491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:38.830480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:38.846065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1052/2110] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:47:38.850324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:38.860654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc2da9-bfa5-4100-bdc4-0328e4a77af5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:38.865023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:38.865606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.865895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.866171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.866847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:38.875013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359240f-79cd-4793-a0ca-c79a6cee07ae None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:38.879801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:38.880380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:38.880674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:38.880952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:38.882800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:38.894800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:38.897006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:38.922254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:38.929442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1053/2111] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:38.931580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:38.936871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1059/2112] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:38 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:47:39.007508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e204-122b-4f1a-9f6e-269c880c0e6d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.011976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.012578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.012879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.013144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.015137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.045345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.066811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1054/2113] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:38 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:39.070815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.080774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed506-2815-4075-b8f2-ae30cbef85bd service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.085043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.085636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.085929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.086207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.086941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.113578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ec65-3bd8-4e1c-855a-4362a1f0494b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.129582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1060/2114] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:39.130983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.141368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85184e78-2354-4c10-823d-3c4c1219ca5c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.145871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.146849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.147153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.147552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] PATH_INFO: `/v3/projects/4707b3e2467e49d4a3f52efd65f3347d/users/3d805fbabe374b3b832ae46041d1e69a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.169037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4707b3e2467e49d4a3f52efd65f3347d, user_id=3d805fbabe374b3b832ae46041d1e69a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.196355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.211234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1055/2115] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:39 2022] PUT /identity/v3/projects/4707b3e2467e49d4a3f52efd65f3347d/users/3d805fbabe374b3b832ae46041d1e69a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:39.221499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.221804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.222091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.259487 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] MFA Rules not processed for user `3d805fbabe374b3b832ae46041d1e69a`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:39.260722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:39.337569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1061/2116] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:39 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:39.342948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.413331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc50d-727e-4991-933d-62e06fa3e0c4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.417658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.418251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.418541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.418853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.419507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.446480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.477371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1056/2117] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:39 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:39.481563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.492226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1761266-e99e-4c29-8370-5afcb8bc38df None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.555792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.556433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.556726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.557010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.557649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.585144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.604995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1062/2118] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:39 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:39.609243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.620335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0fcf-8d40-4e07-9a69-5b03dbf6802f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.625510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.626113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.626403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.627446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.628211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.655379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78d66-9d1f-4d06-96f5-19dc9533c03d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.666864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1057/2119] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:39.671182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.680841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbbc2b-621d-4f8a-af22-5e71a7180676 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.685146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.686511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.686907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.687360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] PATH_INFO: `/v3/projects/e562efd656924ad2b5ee8171afb6373a/users/e29e1c19c64b449498363874e35756f4/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.709131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e562efd656924ad2b5ee8171afb6373a, user_id=e29e1c19c64b449498363874e35756f4, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.735804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:39.749684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1063/2120] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:39 2022] PUT /identity/v3/projects/e562efd656924ad2b5ee8171afb6373a/users/e29e1c19c64b449498363874e35756f4/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:39.761103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.761401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.761690 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.798111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] MFA Rules not processed for user `e29e1c19c64b449498363874e35756f4`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:39.799298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:39.885453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1058/2121] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:39 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:39.890300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:39.956688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4d608-f4be-461f-a62c-7854205b2ea1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:39.960858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:39.961434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:39.961720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:39.961996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:39.962623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:39.989459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.017133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1064/2122] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:39 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:40.021523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.032663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667078e-a9cf-4f4a-bf29-8d0c63862665 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.097579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.098182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.098492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.098802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.099447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.126590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.146355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1059/2123] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:40 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:40.150253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.160042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939a0d-785a-4395-abc4-ea0d2846b47c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.164541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.165134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.165422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.165702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.166401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.192631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.203804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1065/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:40.207946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.218193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759cd66-1689-49b4-95ae-a0080cb3d85c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.222569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.223432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.223723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.224005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] PATH_INFO: `/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.244845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dfec5e0d514a75981fc6375ad54e33, user_id=154fff18b365486fa0e744a975f51dfd, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.271895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.285724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1060/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:40 2022] PUT /identity/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:40.289699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.299907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98af6b-cede-4dff-9b1f-b1eb57591f26 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.365768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.366363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.366647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.366955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.367644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.393462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.405495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1066/2126] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:40.409647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.419472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05e69e-90b0-454a-b7ba-886417d2a0b0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.424030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.424863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.425152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.425440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] PATH_INFO: `/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.427199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dfec5e0d514a75981fc6375ad54e33, user_id=154fff18b365486fa0e744a975f51dfd, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.454940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.465841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1061/2127] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:40 2022] PUT /identity/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:40.469866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.479320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35959a-1922-4ea6-9425-5ccbefe643bc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.544903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.545401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.545675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.545957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.546657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.574573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555ff52-47b7-4892-a7f9-f28a48987a09 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.586129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1067/2128] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:40.590264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.600084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e951e33-6053-4c1b-adb6-90361f337258 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.604255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.605090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.605378 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.605657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] PATH_INFO: `/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.607907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dfec5e0d514a75981fc6375ad54e33, user_id=154fff18b365486fa0e744a975f51dfd, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:40.635902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:40.652190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1062/2129] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:40 2022] PUT /identity/v3/projects/c2dfec5e0d514a75981fc6375ad54e33/users/154fff18b365486fa0e744a975f51dfd/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:40.662961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.663254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.663538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:40.699844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] MFA Rules not processed for user `154fff18b365486fa0e744a975f51dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:40.701076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:40.788615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1068/2130] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:40 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:40.799286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:40.800812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:40.907114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bb18c-085c-4ed5-aaf1-344d4e62a1c6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:40.912784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:40.913530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:40.918957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:40.918957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:41.033152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:41.059877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:41.074968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1063/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:40 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:42.772285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.773684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:42.785539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00683c8b-fb48-491d-bd9d-02963f7c8a97 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.788728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.789293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.789577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.789853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.855462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:42.880974 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.890485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1069/2132] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:42 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:44.121315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:44.129746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c555-4af2-4de7-8a20-e2bd9a34f210 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:44.133098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:44.133664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:44.133951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:44.134228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:44.143442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:44.168913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7eb6fc-66ee-4ba4-8cb5-7b130373819a service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:44.179395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1064/2133] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:44 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:50.718249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:50.786566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017f28-c58f-4014-8e46-38e4f35fdf06 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:50.790646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:50.791463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:50.791750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:50.792028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] PATH_INFO: `/v3/users/3d805fbabe374b3b832ae46041d1e69a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:50.793096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d805fbabe374b3b832ae46041d1e69a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:50.819569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:50.865615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d805fbabe374b3b832ae46041d1e69a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:50.871661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d805fbabe374b3b832ae46041d1e69a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:50.872239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d805fbabe374b3b832ae46041d1e69a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:50.872912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d805fbabe374b3b832ae46041d1e69a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:50.880340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d805fbabe374b3b832ae46041d1e69a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:50.896852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1070/2134] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:50 2022] DELETE /identity/v3/users/3d805fbabe374b3b832ae46041d1e69a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:50.901295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:50.901759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:50.901879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:50.924576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:50.925719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:50.990095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1065/2135] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:51.000154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:51.001537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:51.066787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041a7bb-f10f-462d-9969-56ecc04fbd30 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:51.070151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:51.070698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:51.070981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:51.071262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:51.080330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:51.105613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:51.114575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1071/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:51.453939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:51.455356 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:51.466410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63df86-f3f4-4db5-932a-144a628241bf None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:51.471115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:51.471897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:51.472185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:51.472468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] PATH_INFO: `/v3/projects/4707b3e2467e49d4a3f52efd65f3347d` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:51.473527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4707b3e2467e49d4a3f52efd65f3347d)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:51.499607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:51.550168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4707b3e2467e49d4a3f52efd65f3347d', 'request_id': 'req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.556656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4707b3e2467e49d4a3f52efd65f3347d', 'request_id': 'req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.567836 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4707b3e2467e49d4a3f52efd65f3347d', 'request_id': 'req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.578249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] The token cache is being invalidate because project 4707b3e2467e49d4a3f52efd65f3347d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:51.578524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.579140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.580524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1066/2137] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:51 2022] DELETE /identity/v3/projects/4707b3e2467e49d4a3f52efd65f3347d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:51.584587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:51.594254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f558fa-49d7-4cc2-b3b6-1dbc3539b2ea service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:51.657609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:51.658351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:51.658628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:51.658950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] PATH_INFO: `/v3/users/e29e1c19c64b449498363874e35756f4` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:51.660042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29e1c19c64b449498363874e35756f4)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:51.692227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:51.741844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29e1c19c64b449498363874e35756f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.749737 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29e1c19c64b449498363874e35756f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.750427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29e1c19c64b449498363874e35756f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.751020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29e1c19c64b449498363874e35756f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.758751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29e1c19c64b449498363874e35756f4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:51.776314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1072/2138] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:51 2022] DELETE /identity/v3/users/e29e1c19c64b449498363874e35756f4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:52.192803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:52.194253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:52.209020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1c0f-2410-406d-bc0c-ce2b985de69b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:52.273390 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:52.274179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:52.274464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:52.274774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] PATH_INFO: `/v3/projects/e562efd656924ad2b5ee8171afb6373a` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:52.275858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e562efd656924ad2b5ee8171afb6373a)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:52.302629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:52.350607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e562efd656924ad2b5ee8171afb6373a', 'request_id': 'req-fc63bae3-3f54-48f8-84de-f96552e814e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.357723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e562efd656924ad2b5ee8171afb6373a', 'request_id': 'req-fc63bae3-3f54-48f8-84de-f96552e814e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.368735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e562efd656924ad2b5ee8171afb6373a', 'request_id': 'req-fc63bae3-3f54-48f8-84de-f96552e814e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.378612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] The token cache is being invalidate because project e562efd656924ad2b5ee8171afb6373a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:52.378927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.379654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.381176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1067/2139] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:52 2022] DELETE /identity/v3/projects/e562efd656924ad2b5ee8171afb6373a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:52.385061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:52.386375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:52.398139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf3e2-7828-4588-9941-459d0bf6abbe admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:52.458741 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:52.459481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:52.459767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:52.460044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] PATH_INFO: `/v3/users/154fff18b365486fa0e744a975f51dfd` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:52.461111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=154fff18b365486fa0e744a975f51dfd)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:52.487782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:52.536771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154fff18b365486fa0e744a975f51dfd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.543593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154fff18b365486fa0e744a975f51dfd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.544342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154fff18b365486fa0e744a975f51dfd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.545923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154fff18b365486fa0e744a975f51dfd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.553448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-161b385c-d2ec-41d3-9eac-633c8bc2e4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154fff18b365486fa0e744a975f51dfd'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:52.570602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1073/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:52 2022] DELETE /identity/v3/users/154fff18b365486fa0e744a975f51dfd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:52.924155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:52.925509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:52.937909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bae3-3f54-48f8-84de-f96552e814e3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.001551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.002269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.002555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.002867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] PATH_INFO: `/v3/projects/c2dfec5e0d514a75981fc6375ad54e33` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.003949 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dfec5e0d514a75981fc6375ad54e33)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.030526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.081209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dfec5e0d514a75981fc6375ad54e33', 'request_id': 'req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:53.089798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dfec5e0d514a75981fc6375ad54e33', 'request_id': 'req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:53.102096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dfec5e0d514a75981fc6375ad54e33', 'request_id': 'req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:53.112481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] The token cache is being invalidate because project c2dfec5e0d514a75981fc6375ad54e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:53.112762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:53.113363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-302c0431-43f6-4ea0-bfe5-3fc0b8aa8023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:53.114842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1068/2141] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:52 2022] DELETE /identity/v3/projects/c2dfec5e0d514a75981fc6375ad54e33 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:53.119624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.120117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.120204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.142480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:53.143896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:53.208068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1074/2142] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:53.216437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.217144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.217144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.239252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:53.240403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:53.247383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1069/2143] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:53.252145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.261130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc6014-3027-4bfe-a15d-5d0c4fba8363 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.267041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.267641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.267929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.268210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.268911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:47:53.269213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.295038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.312343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1075/2144] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:53.316845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.326323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d06ec-aad8-4dd4-a145-cf3d4c5b15cf None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.330938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.331519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.331808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.332089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.332748 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.358930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.385552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1070/2145] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:53 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:53.390650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.400050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01362a-f7f9-40df-8325-52a837749087 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.463694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.464290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.464580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.464860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.465492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.491572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.509678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1076/2146] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:53 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:53.514595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.524222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5312a-8fb0-48b9-a91e-111e8fec740c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.528359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.529551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.529834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.530112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.530844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.556234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faefdb9-86f3-4807-8447-930f2de1e0de admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.566742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1071/2147] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:53.570709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.581602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92cde-6c4a-4b34-bd44-fd8c3929f206 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.586506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.587359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.587649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.588666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] PATH_INFO: `/v3/projects/e7ae88e45b2247aebb1e6c63d37a379f/users/f72e978d7ab64825acbde29f3eb02d3a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.608483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ae88e45b2247aebb1e6c63d37a379f, user_id=f72e978d7ab64825acbde29f3eb02d3a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.634318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.648254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1077/2148] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:53 2022] PUT /identity/v3/projects/e7ae88e45b2247aebb1e6c63d37a379f/users/f72e978d7ab64825acbde29f3eb02d3a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:53.658813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.659111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.659395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.696351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] MFA Rules not processed for user `f72e978d7ab64825acbde29f3eb02d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:53.697507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:53.767926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1072/2149] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:53.777159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:53.778844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:53.842463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656cf88-0a12-4f83-832e-88b9a1e29206 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:53.846010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:53.846592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:53.846919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:53.847204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:53.855314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:47:53.881841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61290e0-0d14-4312-86f3-4846eaaa4f5f service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:53.892249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1078/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:53 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:39.489225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:39.560657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a0558-a596-45c1-afc2-1dd9dd422401 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:39.564659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:39.565488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:39.565778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:39.566067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] PATH_INFO: `/v3/users/f72e978d7ab64825acbde29f3eb02d3a` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:39.567213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72e978d7ab64825acbde29f3eb02d3a)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:39.593217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:39.642168 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72e978d7ab64825acbde29f3eb02d3a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:39.654680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72e978d7ab64825acbde29f3eb02d3a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:39.655321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72e978d7ab64825acbde29f3eb02d3a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:39.655894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72e978d7ab64825acbde29f3eb02d3a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:39.663300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72e978d7ab64825acbde29f3eb02d3a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:39.677090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1073/2151] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:48:39 2022] DELETE /identity/v3/users/f72e978d7ab64825acbde29f3eb02d3a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:39.681540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:39.682022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:39.682112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:39.704815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:39.705970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:39.769061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1079/2152] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:48:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:39.779693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:39.781000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:39.844133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cdbd4-1c79-4577-b998-441c4554478c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:39.847492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:39.848059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:39.848376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:39.848627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:39.857925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:39.885019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:39.896456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1074/2153] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:40.250949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:40.252226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:40.264999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b35ca8-825e-4ad6-95bc-978d071ce8e1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:40.269347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:40.270250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:40.270535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:40.270920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] PATH_INFO: `/v3/projects/e7ae88e45b2247aebb1e6c63d37a379f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:40.272181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ae88e45b2247aebb1e6c63d37a379f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:40.298513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:40.350511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ae88e45b2247aebb1e6c63d37a379f', 'request_id': 'req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:40.355581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ae88e45b2247aebb1e6c63d37a379f', 'request_id': 'req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:40.366540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ae88e45b2247aebb1e6c63d37a379f', 'request_id': 'req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:40.382900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] The token cache is being invalidate because project e7ae88e45b2247aebb1e6c63d37a379f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:48:40.383284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:40.384107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aa2d5bc7-f3ba-47fc-82c9-db1229b37304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:40.385578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1080/2154] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:48:40 2022] DELETE /identity/v3/projects/e7ae88e45b2247aebb1e6c63d37a379f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:42.940583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:42.942004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:42.954316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b15c-723e-4f92-a58a-a04c73ce38e8 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:43.020301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:43.021181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.021540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.021891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] PATH_INFO: `/v3/users/39261ec9dd3d4ccc919f3474e8bebc5a` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.023091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=39261ec9dd3d4ccc919f3474e8bebc5a)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:43.050681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:43.099846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39261ec9dd3d4ccc919f3474e8bebc5a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.111595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39261ec9dd3d4ccc919f3474e8bebc5a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.112219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39261ec9dd3d4ccc919f3474e8bebc5a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.112789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39261ec9dd3d4ccc919f3474e8bebc5a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.120251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39261ec9dd3d4ccc919f3474e8bebc5a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.132350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1075/2155] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:48:42 2022] DELETE /identity/v3/users/39261ec9dd3d4ccc919f3474e8bebc5a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:43.137387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.138017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.138017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.160001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:43.161136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:43.227362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1081/2156] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:43.237630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:43.239005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:43.304055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107270-d247-4378-bde7-72dab981f2fd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:43.307454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:43.308068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.308357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.308637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.318061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:43.343337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde46a5-bac9-4181-a2cd-82a9c04ee8b4 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:43.352402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1076/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:48:43.691423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:43.698463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:43.710884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ae17c-d6ed-4f5d-81dd-f352b09756ab None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:43.716171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:43.717050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.717347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.717626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] PATH_INFO: `/v3/projects/6e020aa62daf451494acf416fae6e502` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.718747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e020aa62daf451494acf416fae6e502)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:43.743995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:43.793538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e020aa62daf451494acf416fae6e502', 'request_id': 'req-9d193266-130c-4f26-b719-c2a4a68c29a9'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.798644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e020aa62daf451494acf416fae6e502', 'request_id': 'req-9d193266-130c-4f26-b719-c2a4a68c29a9'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.809289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e020aa62daf451494acf416fae6e502', 'request_id': 'req-9d193266-130c-4f26-b719-c2a4a68c29a9'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.821015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] The token cache is being invalidate because project 6e020aa62daf451494acf416fae6e502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:48:43.821282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.821871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9d193266-130c-4f26-b719-c2a4a68c29a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:43.823299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1082/2158] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:48:43 2022] DELETE /identity/v3/projects/6e020aa62daf451494acf416fae6e502 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:43.828853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.829201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.829492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.852316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:43.853459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:43.917059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1077/2159] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:43.924514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.924808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.925091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.947659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:43.948889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:43.958913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1083/2160] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:43.960941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:43.970106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f491e-9be4-41ae-9b55-1b649ef30a90 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:43.974405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:43.975034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:43.975328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:43.975613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:43.976306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:48:43.976610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.002601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.018822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1078/2161] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:48:44.021121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.031115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8de11-c6dd-435d-b328-ea8cf132d516 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.035408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.035992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.036285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.036570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.037209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.068686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.099675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1084/2162] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:48:44 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:48:44.103787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.113940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f41271-ae11-40b4-af1b-743650f6906d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.175307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.175827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.176118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.176401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.177041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.203838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.223918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1079/2163] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:48:44 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:48:44.227978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.237786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a52c-295b-45f3-8948-fe5541f6147e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.242020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.242612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.242938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.243226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.243921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.270372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22dd9c-c335-4656-8014-02c29a4121ee admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.280549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1085/2164] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:48:44.284596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.294153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983f179-1aa5-4139-9dc1-9505d928d635 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.298361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.299199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.299490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.299777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] PATH_INFO: `/v3/projects/1add1fcc0ba44bef9108e22b3dbaec67/users/fccdb83c4667495ea31b440b961ddc37/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.319832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1add1fcc0ba44bef9108e22b3dbaec67, user_id=fccdb83c4667495ea31b440b961ddc37, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.346742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.359652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1080/2165] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:48:44 2022] PUT /identity/v3/projects/1add1fcc0ba44bef9108e22b3dbaec67/users/fccdb83c4667495ea31b440b961ddc37/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:48:44.369677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819ff7-1064-4431-a778-bd323c08f92a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.369975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819ff7-1064-4431-a778-bd323c08f92a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.370260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65819ff7-1064-4431-a778-bd323c08f92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.407305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-65819ff7-1064-4431-a778-bd323c08f92a None None] MFA Rules not processed for user `fccdb83c4667495ea31b440b961ddc37`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:44.408463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-65819ff7-1064-4431-a778-bd323c08f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:44.477609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1086/2166] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:48:44 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:44.487837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.489429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:44.553211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1736-c281-4edb-8a1f-aa4046cb7625 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.556550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.557121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.557407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.557687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.566173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:48:44.591113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f64f-29d2-4194-ab2a-9fcf333470a1 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.599416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1081/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:44 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:08.443110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51123c-af47-4f2c-af89-f208e0ece886 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:08.443622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51123c-af47-4f2c-af89-f208e0ece886 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:08.443731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51123c-af47-4f2c-af89-f208e0ece886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:08.466422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4f51123c-af47-4f2c-af89-f208e0ece886 None None] MFA Rules not processed for user `6b94017d79f24adaa76748899bc7c014`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:08.467541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4f51123c-af47-4f2c-af89-f208e0ece886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:08.530182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1087/2168] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:08 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:18.305405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:18.305981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:18.306176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:18.331472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] MFA Rules not processed for user `b68bc45984974d6da1c9151c21dae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:18.332751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:18.403745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1082/2169] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:31.969264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:31.969721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:31.969869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:32.059020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:32.059020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:32.139853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1088/2170] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:49:31 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:32.184414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:32.186297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:32.289654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cda6b-0e20-4300-95c1-9f6e2c573efb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:32.294855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:32.295438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:32.295725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:32.296237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:32.304546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:32.330563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:32.339064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1083/2171] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:49:32.988317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:32.990353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:33.066966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524887-1045-425d-9d09-d2579d1dbedb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:33.071484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:33.072073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:33.072486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:33.072777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:33.075827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:33.203532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:33.230206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:33.253025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1089/2172] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:32 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:34.560802 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:34.578721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998794-2627-4982-ae14-00efe0112f2b service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:34.599904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:34.603658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:34.604594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:34.605400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:34.609383 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:34.629998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:34.676907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980eef8-1587-450c-a677-68f1d8757810 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:34.692761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1084/2173] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:34 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:44.477906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:44.547486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40052d-de72-4102-9934-d2db153a3cac service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:44.551527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:44.552312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:44.552599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:44.552876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] PATH_INFO: `/v3/users/fccdb83c4667495ea31b440b961ddc37` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:44.553940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccdb83c4667495ea31b440b961ddc37)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:44.579824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:44.628526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccdb83c4667495ea31b440b961ddc37'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:44.636198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccdb83c4667495ea31b440b961ddc37'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:44.636857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccdb83c4667495ea31b440b961ddc37'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:44.637430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccdb83c4667495ea31b440b961ddc37'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:44.645305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccdb83c4667495ea31b440b961ddc37'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:44.663062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1090/2174] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:49:44 2022] DELETE /identity/v3/users/fccdb83c4667495ea31b440b961ddc37 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:49:44.667792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:44.668306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:44.668408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:44.691312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:44.692393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:44.755653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1085/2175] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:44.766406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:44.767758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:44.830301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dcb33-54b3-42b6-a703-edb74ce8d6f9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:44.833649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:44.834225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:44.834515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:44.834830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:44.844630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:44.870076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f98d-401a-4681-bde8-6e4d16359d60 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:44.879171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1091/2176] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:49:45.278362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.279898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:45.293256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd3719-8d16-48e8-8ff7-f8c2de4c107d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.297428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.298303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.298658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.299029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] PATH_INFO: `/v3/projects/1add1fcc0ba44bef9108e22b3dbaec67` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.300176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1add1fcc0ba44bef9108e22b3dbaec67)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.328404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.377302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1add1fcc0ba44bef9108e22b3dbaec67', 'request_id': 'req-8493e145-5c25-4e09-a4b9-4d665bff21d4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:45.383468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1add1fcc0ba44bef9108e22b3dbaec67', 'request_id': 'req-8493e145-5c25-4e09-a4b9-4d665bff21d4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:45.395399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1add1fcc0ba44bef9108e22b3dbaec67', 'request_id': 'req-8493e145-5c25-4e09-a4b9-4d665bff21d4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:45.405790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] The token cache is being invalidate because project 1add1fcc0ba44bef9108e22b3dbaec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:49:45.406075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:45.406692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-8493e145-5c25-4e09-a4b9-4d665bff21d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:49:45.408105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1086/2177] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:49:45 2022] DELETE /identity/v3/projects/1add1fcc0ba44bef9108e22b3dbaec67 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:49:45.413170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.413465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.413769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.437764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:45.438949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:45.502876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1092/2178] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:45.511074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.511374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.511666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.533915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:45.535092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:45.542889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1087/2179] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:45.547128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.556115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b0e9-0de6-4424-805d-03e1e79609aa None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.561034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.561611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.561896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.562195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.562895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:49:45.563193 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.589245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.602071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1093/2180] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:49:45.607201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.615981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081047a-4108-4fe7-b98a-d9fce0980709 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.620797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.621380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.621671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.621957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.622590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.649043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.677537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1088/2181] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:49:45 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:49:45.682770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.692634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f71b-51df-4207-aa9e-d15289aa073f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.753793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.754315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.754600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.754907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.755546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.782073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.802254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1094/2182] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:49:45 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:49:45.806435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.816870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c7b45-588e-4113-adf3-18ee2305464b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.821061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.821653 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.821944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.822229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.823100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.848404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb6732-e5a9-4211-a7f8-b26d5048d68d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.859055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1089/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:49:45.863153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:45.873225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73127d5e-120d-4171-bfd7-791ef627c924 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:45.877432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:45.878238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.878527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.878841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] PATH_INFO: `/v3/projects/89f311117084470f8e8d16c47ad1d2ae/users/a86a950d41cc44fb9f10b600b20b0ae6/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.898556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f311117084470f8e8d16c47ad1d2ae, user_id=a86a950d41cc44fb9f10b600b20b0ae6, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:45.924968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:45.938049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1095/2184] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:49:45 2022] PUT /identity/v3/projects/89f311117084470f8e8d16c47ad1d2ae/users/a86a950d41cc44fb9f10b600b20b0ae6/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:49:45.943097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:45.943401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:45.943692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:45.968371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:45.969618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:46.036357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1090/2185] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:46.046928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:46.048512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:46.112825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3245a9c-56af-40be-92c0-7208bbf59bec admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:46.116127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:46.116696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:46.116983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:46.117258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:46.126528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:46.151415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:46.160138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1096/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:48.791620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:48.793035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:48.910564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a813-a150-4673-98ec-7bae5e2df18d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:48.917225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:48.918335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:48.918335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:48.918538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:48.927229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:49.009714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:49.041293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc5210-100c-444d-8130-ab430e16f899 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:49.054541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1091/2187] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:48 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:50.027709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:50.041214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c720425-cc43-4b6c-8b9d-d0781aea78e7 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:50.046658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:50.048053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:50.048663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:50.049164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:50.051557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:50.064443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:50.092443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:50.101773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1097/2188] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:50 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:52.036400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.036907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.037000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.080496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] MFA Rules not processed for user `a86a950d41cc44fb9f10b600b20b0ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:52.081665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:52.159717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1092/2189] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:52.164244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.175343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5411dd-85c0-4581-92e2-3bb74a84eed2 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.179440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.180027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.180313 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.180590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.181231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.207662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.239029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1098/2190] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:49:52 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:49:52.242925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.254124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29574f2-3f0a-42d1-8c0c-951d7c83f92e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.331969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.332704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.333062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.333416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.334293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.364261 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.396003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1093/2191] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:49:52 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:49:52.399634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.412291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869044c-407d-4d84-8aeb-01b69a6f5b2b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.417769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.418372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.418688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.418978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.419688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.447189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.461559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1099/2192] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:49:52.463229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.473750 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fc684-e676-4215-8196-9e668e92a7a5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.479297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.480128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.480563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.480883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] PATH_INFO: `/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.502422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2693886eb62643358125af592825867f, user_id=1e3d36f842884e828bc17c50b319fcd2, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.530057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.545043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1094/2193] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:49:52 2022] PUT /identity/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:49:52.549197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.559081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2671f4-646b-4163-8db4-dd4693c4dbac admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.628352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af860-08ff-441b-907a-a590556789ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.628960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af860-08ff-441b-907a-a590556789ed admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.629273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af860-08ff-441b-907a-a590556789ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.629540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117af860-08ff-441b-907a-a590556789ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.630253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117af860-08ff-441b-907a-a590556789ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.657866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117af860-08ff-441b-907a-a590556789ed admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.668864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1100/2194] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:49:52.673032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.683339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8fee6-6e09-4f56-81b4-ebabf4f28a16 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.687638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.688496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.688834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.689143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] PATH_INFO: `/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.690991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2693886eb62643358125af592825867f, user_id=1e3d36f842884e828bc17c50b319fcd2, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.719308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.729931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1095/2195] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:49:52 2022] PUT /identity/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:49:52.733796 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af860-08ff-441b-907a-a590556789ed admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.743295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117af860-08ff-441b-907a-a590556789ed admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.809169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.809917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.810249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.810590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.811456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.839361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.849298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1101/2196] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:49:52.853959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.863822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83292b-2ee1-4858-aebf-9831681ee175 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.867965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.868783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.869562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.869879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] PATH_INFO: `/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.871695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2693886eb62643358125af592825867f, user_id=1e3d36f842884e828bc17c50b319fcd2, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:52.899237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b7bb0-24bc-4c7b-af93-6f0c5bd5edcc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.913642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1096/2197] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:49:52 2022] PUT /identity/v3/projects/2693886eb62643358125af592825867f/users/1e3d36f842884e828bc17c50b319fcd2/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:49:54.236566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:54.238252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:54.312266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ade5a-6598-49a0-9ae4-a47a7bf87790 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:54.377211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:54.378173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:54.378463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:54.378787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:54.380489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:54.391052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:54.417055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231bd19-782d-4560-8d4a-cde2cbad97b2 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:54.426170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1102/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:54 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:54.879197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4f91-6fc8-45cb-a834-dc9510a543c7 None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:54.880253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4f91-6fc8-45cb-a834-dc9510a543c7 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:54.880609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4f91-6fc8-45cb-a834-dc9510a543c7 None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:54.883224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1097/2199] 10.222.0.48 () {54 vars in 921 bytes} [Fri Apr 8 02:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:49:54.889326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:54.889691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:54.889949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:54.917850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] MFA Rules not processed for user `a21543ae332b47c88db79bc1fd6e127e`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:54.919133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:54.926137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1103/2200] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Apr 8 02:49:54 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:49:54.942025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4f91-6fc8-45cb-a834-dc9510a543c7 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:54.954829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4f91-6fc8-45cb-a834-dc9510a543c7 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:54.958555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:54.959415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:54.959940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:54.960557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:54.969344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:55.000818 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:55.014009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1098/2201] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:54 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:55.179992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:55.182061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:55.320617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ad85e-6ff1-4222-9b48-7d63dde84152 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:55.327384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:55.328010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:55.328010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:55.328207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:55.330079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:55.347686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:55.382263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058d26-966d-4998-99ea-beaf2a501e1c service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:55.398482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1104/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:55.552794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:55.554137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:55.573477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f0b4-8ea3-48d8-9596-352c910fd87c service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:55.579109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:55.579958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:55.580320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:55.580670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:55.582553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:55.596574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:49:55.627511 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:55.641090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1099/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:59.248761 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b54d-4061-488b-8d2f-88a66abe04b3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:59.249848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b54d-4061-488b-8d2f-88a66abe04b3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:59.250330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b54d-4061-488b-8d2f-88a66abe04b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:59.292251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e806b54d-4061-488b-8d2f-88a66abe04b3 None None] MFA Rules not processed for user `1e3d36f842884e828bc17c50b319fcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:59.293628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e806b54d-4061-488b-8d2f-88a66abe04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:59.485076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1105/2204] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:49:59 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:59.838985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:00.017273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac52f9-2cbd-4dab-9df1-8a3959444ddb service placement] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:00.033246 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:00.034355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:00.035126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:00.035358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:00.128301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:00.186123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40deaf6-18df-47f0-b74e-97069038b571 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:00.198610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1100/2205] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:59 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:02.084506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:02.085055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:02.085166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:02.108946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:02.110129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:02.148219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da342-526c-4251-9195-2cde1df98763 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:02.148686 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da342-526c-4251-9195-2cde1df98763 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:02.148782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da342-526c-4251-9195-2cde1df98763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:02.172358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-114da342-526c-4251-9195-2cde1df98763 None None] MFA Rules not processed for user `a86a950d41cc44fb9f10b600b20b0ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:02.173440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-114da342-526c-4251-9195-2cde1df98763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:02.175184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1106/2206] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:02.179575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1101/2207] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:02.187714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:02.189250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:02.268757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e356-2db8-49c0-b3ba-838b41a1cfe9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:02.273392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:02.273951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:02.274151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:02.274448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:02.283365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:02.310535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:02.319338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1107/2208] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:50:15.684050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da342-526c-4251-9195-2cde1df98763 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:15.701870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da342-526c-4251-9195-2cde1df98763 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:15.709145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:15.709737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:15.710236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:15.711085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:15.713968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:15.726644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:15.752659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:15.764172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1102/2209] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:15 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:21.966283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:21.967914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:21.982630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f164cc-4927-4380-9fb9-fca6955dc452 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:21.987626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:21.988208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:21.988495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:21.988918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:21.990630 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:22.061421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:22.087745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c40342-f8c0-40e1-b020-c1a3d3c1fddf service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:22.096758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1108/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:21 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:31.714045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:31.726075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae2c73-4cb1-4c30-bde5-97bb3f99b792 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:31.731797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:31.732765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:31.733220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:31.733670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:31.735576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:31.747790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:31.774412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:31.785495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1103/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:31 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:39.127590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:39.129019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:39.129511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:39.162620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:39.164854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:39.177610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1109/2212] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:50:39 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:39.204735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:39.217308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552019-3450-4c58-ba1a-7a418ae56936 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:39.223972 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:39.225236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:39.225846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:39.226380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:39.252894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:39.281572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:39.291178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1104/2213] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:50:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:50:50.038339 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:50.040272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:50.110870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad2cbd-ffaa-41cd-a2e8-b9e294e10c78 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:50.115022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:50.115763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.116053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.116336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] PATH_INFO: `/v3/users/6b94017d79f24adaa76748899bc7c014` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.117428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b94017d79f24adaa76748899bc7c014)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:50.144502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:50.191316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b94017d79f24adaa76748899bc7c014'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.198723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b94017d79f24adaa76748899bc7c014'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.199305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b94017d79f24adaa76748899bc7c014'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.199879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b94017d79f24adaa76748899bc7c014'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.207474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-aae867e5-6fac-4f45-83d1-86f80137d324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b94017d79f24adaa76748899bc7c014'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.223760 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1110/2214] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:50:50 2022] DELETE /identity/v3/users/6b94017d79f24adaa76748899bc7c014 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:50.453954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:50.464159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a7b3-1ff1-4baf-a2f8-9c350a9eb873 service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:50.533665 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:50.534542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.534936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.535296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] PATH_INFO: `/v3/projects/5fb44db14d6e4c14b82c05f28e8ee9d9` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.536483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb44db14d6e4c14b82c05f28e8ee9d9)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:50.564560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:50.631349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'request_id': 'req-57ec24af-385d-4c47-ae47-d63dbbcc0fda'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.639124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'request_id': 'req-57ec24af-385d-4c47-ae47-d63dbbcc0fda'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.651966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'request_id': 'req-57ec24af-385d-4c47-ae47-d63dbbcc0fda'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.663389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] The token cache is being invalidate because project 5fb44db14d6e4c14b82c05f28e8ee9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:50:50.663673 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.664292 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-57ec24af-385d-4c47-ae47-d63dbbcc0fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:50.667318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1105/2215] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:50:50 2022] DELETE /identity/v3/projects/5fb44db14d6e4c14b82c05f28e8ee9d9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:50.671995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.672314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.672598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.694474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:50.695735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:50.768236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1111/2216] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:50.770023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.770395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.770756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.802870 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:50.804220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:50.811925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1106/2217] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:50.816112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:50.825390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3c1d-4dec-4581-a448-c0bf2fee2332 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:50.829789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:50.830375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.830691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.830973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.831667 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:50:50.831963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:50.858046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:50.871706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1112/2218] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:50:50.875898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:50.884931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752791df-f6d0-4dc9-a35a-bc3662dd8ec1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:50.889395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:50.889971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:50.890260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:50.890534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:50.891197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:50.918036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:50.944370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1107/2219] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:50:50 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:50:50.948425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:50.958490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513aa47-5d4b-40e4-a37a-51e960ea92df admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:51.022763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:51.023367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:51.023657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:51.024565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:51.025199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:51.051439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:51.071503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1113/2220] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:50:50 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:50:51.075613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:51.085127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406236-da0e-4597-b639-15be8df004b8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:51.090322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:51.090948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:51.091236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:51.091515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:51.092201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:51.117054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4c060-6d05-4124-a2e7-c09611e2bfd5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:51.127613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1108/2221] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:50:51.131483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:51.141598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c99777-fd30-4120-a9ff-29724826a2c6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:51.145694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:51.146496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:51.146821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:51.147114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] PATH_INFO: `/v3/projects/6eb5fe9c67d048c5b2097f9a923ac025/users/f5b08a414e0c45ab839107cccb69f179/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:51.167003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb5fe9c67d048c5b2097f9a923ac025, user_id=f5b08a414e0c45ab839107cccb69f179, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:51.193073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:51.206319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1114/2222] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:51 2022] PUT /identity/v3/projects/6eb5fe9c67d048c5b2097f9a923ac025/users/f5b08a414e0c45ab839107cccb69f179/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:51.211412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a35d-e4f9-4671-b7d3-95e8a48082d4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:51.212310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a35d-e4f9-4671-b7d3-95e8a48082d4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:51.212785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a35d-e4f9-4671-b7d3-95e8a48082d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:51.234647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4cc1a35d-e4f9-4671-b7d3-95e8a48082d4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:51.235823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4cc1a35d-e4f9-4671-b7d3-95e8a48082d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:51.300107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1109/2223] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:51.310077 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:51.311742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:51.378693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8b00-1190-4d07-8a71-bf04d4ff378f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:51.382453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:51.383123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:51.383883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:51.384189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:51.393369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:51.418577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:51.427427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1115/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:56.815805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:56.816343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:56.816452 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:56.852457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] MFA Rules not processed for user `f5b08a414e0c45ab839107cccb69f179`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:56.853601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:56.923073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1110/2225] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:56.927422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:56.937367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03badd1-ae87-4f8d-8763-b5830e7a4633 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:56.941544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:56.942125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:56.942414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:56.942720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:56.943368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:56.969557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.086308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1116/2226] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:50:56 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:50:57.090468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.100553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e74092-ec35-4383-b8ba-16e73d94d42f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.163864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.165217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.165217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.165552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.166135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.192724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.212026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1111/2227] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:50:57 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:50:57.216022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.225676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39db2-9c6b-4cce-9575-376f66a7512e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.230373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.231012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.231303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.231587 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.232279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.257747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.268882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1117/2228] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:50:57.272891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.282392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a80772-6d2e-4cd1-ba38-2a2f6b2f4d93 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.286630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.287474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.287773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.288065 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] PATH_INFO: `/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.308608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abe65b75c49425d8eee644b8ac3a281, user_id=1650cb93329a4edf89f6cad7a5869931, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.334626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.347707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1112/2229] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:57 2022] PUT /identity/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:57.351563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.361849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c436d-f9ba-42d5-a2a9-42bf2e9794fd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.434762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.435399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.435663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.435947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.436657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.462978 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.476216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1118/2230] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:50:57.482774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.504025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937794a4-ddea-47f3-a805-47d49c017a64 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.509405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.510637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.511231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.511951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] PATH_INFO: `/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.514506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abe65b75c49425d8eee644b8ac3a281, user_id=1650cb93329a4edf89f6cad7a5869931, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.544640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.556523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1113/2231] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:57 2022] PUT /identity/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:57.560283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.571914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40507b-c155-4592-b625-3c624e948753 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.640255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.640770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.641037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.641314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.642012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.667724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.678443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1119/2232] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:50:57.684110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:57.696761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1730616-9056-4d27-b4e5-c7ee17c3da0c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:57.705173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:57.707717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:57.708180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:57.709127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] PATH_INFO: `/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:57.711944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abe65b75c49425d8eee644b8ac3a281, user_id=1650cb93329a4edf89f6cad7a5869931, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:57.744938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:57.763658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1114/2233] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:57 2022] PUT /identity/v3/projects/9abe65b75c49425d8eee644b8ac3a281/users/1650cb93329a4edf89f6cad7a5869931/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:50:58.097901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:58.170353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc0bbe-b940-4f93-ac66-b50063c66e85 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:58.232229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:58.232807 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:58.233496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:58.233496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:58.235256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:58.313027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:50:58.339135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907eab8-fec8-46d5-ad6f-b157162b90d8 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:58.349911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1120/2234] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:02.383726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:02.386024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:02.401117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a634-b677-4310-82f9-f9ca6ea351b1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:02.401659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a634-b677-4310-82f9-f9ca6ea351b1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:02.402065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622a634-b677-4310-82f9-f9ca6ea351b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:02.442941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-e622a634-b677-4310-82f9-f9ca6ea351b1 None None] MFA Rules not processed for user `153666ecd9c84936bd1c9ce32373ca27`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:02.445083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e622a634-b677-4310-82f9-f9ca6ea351b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:02.531991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1121/2235] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:51:02 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:51:02.542088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cc5f-9e6c-4026-912b-355c653effd0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:02.560733 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:02.561510 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:02.561887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:02.562339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:02.564295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:02.587255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:02.613023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:02.624150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1115/2236] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:05.412675 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de166df-4587-4f03-9c5e-87f62715e947 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:05.413589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de166df-4587-4f03-9c5e-87f62715e947 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:05.413876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de166df-4587-4f03-9c5e-87f62715e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:05.456465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5de166df-4587-4f03-9c5e-87f62715e947 None None] MFA Rules not processed for user `1650cb93329a4edf89f6cad7a5869931`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:05.457612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5de166df-4587-4f03-9c5e-87f62715e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:05.533797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1122/2237] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:05.546696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:05.548030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:05.641799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a19fde-5dd4-40dc-99ac-b97d354f032c service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:05.645313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:05.645898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:05.646191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:05.646475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:05.711574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:05.736842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:05.746772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1116/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:05 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:05.865222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0df7-5b7c-4845-bcbf-209548f64816 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:05.865767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0df7-5b7c-4845-bcbf-209548f64816 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:05.866330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0df7-5b7c-4845-bcbf-209548f64816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:05.896031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-568b0df7-5b7c-4845-bcbf-209548f64816 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:05.897357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-568b0df7-5b7c-4845-bcbf-209548f64816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:05.972689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1123/2239] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:05.987326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:05.988994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:06.076975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4a0e-68af-4348-8a2b-d68a26258d54 service glance] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:06.081698 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:06.082312 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:06.082609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:06.082925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:06.095589 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:06.118792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f0908-0783-425f-9e04-79ac744cf62a service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:06.127049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1117/2240] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:51:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:51:16.017651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:16.018179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:16.018281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:16.039919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] MFA Rules not processed for user `f5b08a414e0c45ab839107cccb69f179`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:16.041190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:16.047612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1124/2241] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:51:16 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:18.193440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:18.193973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:18.194085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:18.216423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:18.217605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:18.224198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1118/2242] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:51:18 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:18.236462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:18.248318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9168-8190-461a-b3bf-102f425dbc3e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:18.252896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:18.253492 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:18.253784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:18.254069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:18.264122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:18.290518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:18.299528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1125/2243] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:51:35.207885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:35.221121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf31ab-e1b4-4966-bf9c-13a6066121b5 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:35.226165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:35.226979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:35.227275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:35.227587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:35.229513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:35.302460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:35.328156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:35.338308 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1119/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:42.737456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:42.749334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037e281-4d6b-4456-a8d6-5b13645c9142 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:42.754202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:42.754813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:42.755107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:42.755384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:42.757104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:42.822469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:42.847064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa40060-519c-47a7-8e52-0dbcd04058ce service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:42.856423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1126/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:42 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:55.625049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:55.626441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:55.637839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a21a8b-f97f-40c2-8785-343ba8b07411 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:55.641267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:55.641842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:55.642132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:55.642416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:55.651343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:51:55.676599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6fe11-0283-41aa-9c26-2216cd370045 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:55.686560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1120/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:55 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:04.700661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:04.701196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:04.701423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:04.724029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] MFA Rules not processed for user `b68bc45984974d6da1c9151c21dae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:04.725225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:04.731694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1127/2247] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:04 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:16.881557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:16.882459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:16.883434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:16.991503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] MFA Rules not processed for user `f7cf97b0aa15496393f1a39d5ef759de`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:16.993295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:17.068384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1121/2248] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:16 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:17.646184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:17.657020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455a1ae-dffe-496d-bd5f-5f2fc243d5e5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:17.660513 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:17.661102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:17.661397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:17.661678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:17.663383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:17.674563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:17.703613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:17.713411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1128/2249] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:17 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:28.620967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:28.630163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7e552-c67d-4ff8-8af6-560d49f8e82d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:28.633577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:28.634147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:28.634443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:28.634852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:28.636491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:28.705788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:28.731753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:28.741348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1122/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:35.104749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:35.107865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:35.122392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455154-3f39-4536-af2e-e75804451d4d service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:35.127129 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:35.128113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.128478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.128831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] PATH_INFO: `/v3/users/153666ecd9c84936bd1c9ce32373ca27` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.130017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153666ecd9c84936bd1c9ce32373ca27)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:35.156506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:35.211375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153666ecd9c84936bd1c9ce32373ca27'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.223754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153666ecd9c84936bd1c9ce32373ca27'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.224449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153666ecd9c84936bd1c9ce32373ca27'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.225032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153666ecd9c84936bd1c9ce32373ca27'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.234435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d52748ed-f50b-44d3-ae00-60d7ff1eb9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153666ecd9c84936bd1c9ce32373ca27'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.260516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1129/2251] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:35 2022] DELETE /identity/v3/users/153666ecd9c84936bd1c9ce32373ca27 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:35.522853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:35.536110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7730b-da69-4ec0-b8f0-cf6e9686b32a service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:35.603980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:35.604852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.605147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.605546 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] PATH_INFO: `/v3/projects/2f0c4cd55acc4607852747c5d796609e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.606769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0c4cd55acc4607852747c5d796609e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:35.633241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:35.686169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0c4cd55acc4607852747c5d796609e', 'request_id': 'req-f25c5d26-ff28-47ba-99de-426efdd7afa4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.694259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0c4cd55acc4607852747c5d796609e', 'request_id': 'req-f25c5d26-ff28-47ba-99de-426efdd7afa4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.706962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0c4cd55acc4607852747c5d796609e', 'request_id': 'req-f25c5d26-ff28-47ba-99de-426efdd7afa4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.719577 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] The token cache is being invalidate because project 2f0c4cd55acc4607852747c5d796609e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:35.719875 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.720499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f25c5d26-ff28-47ba-99de-426efdd7afa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:35.721922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1123/2252] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:35 2022] DELETE /identity/v3/projects/2f0c4cd55acc4607852747c5d796609e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:35.727191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.727706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.728159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.753107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:35.754285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:35.829808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1130/2253] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:35.837612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.838103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.838473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.865525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:35.867273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:35.876513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1124/2254] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:35.880715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:35.891826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e2eda-4488-43c2-94ca-6251e4afb355 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:35.897727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:35.899091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.899496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.899855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.900598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:35.900960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:35.926347 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:35.940592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1131/2255] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:35.945809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:35.955631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b908cc-b533-4c15-b5c0-38a39f48c2a4 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:35.961060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:35.961671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:35.962050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:35.962337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:35.963581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.000605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.030604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1125/2256] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:35 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:36.034707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.044895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e553d5-212c-44c7-baad-d272cdbc0ee7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.107924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.108592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.108812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.109090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.109734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.136328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.160398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1132/2257] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:36 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:36.161830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.173410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d02157-b357-4605-b144-41cb57bc7b9e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.177632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.178236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.178524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.178834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.179841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.206332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f490f-3eab-4825-bb94-3f74cac3567b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.217787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1126/2258] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:36.221971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.232034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e2682-5cf1-4afc-a000-d5da321fe663 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.236374 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.237242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.237519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.237803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] PATH_INFO: `/v3/projects/915f87d297844ffab607e11194ce869b/users/cbe0851b64654ac38c0b604fab7063a3/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.259407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915f87d297844ffab607e11194ce869b, user_id=cbe0851b64654ac38c0b604fab7063a3, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.285893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.301007 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1133/2259] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:36 2022] PUT /identity/v3/projects/915f87d297844ffab607e11194ce869b/users/cbe0851b64654ac38c0b604fab7063a3/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:36.310879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.311184 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.311503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.352118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] MFA Rules not processed for user `cbe0851b64654ac38c0b604fab7063a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:36.353293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:36.431567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1127/2260] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:36 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:36.435996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.504828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e2a5-36e0-43ee-848e-d02de2ad7321 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.509100 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.510091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.510381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.510659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.511322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.537918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.574484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1134/2261] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:36 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:36.575610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.586586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b0ba0-ad8d-419c-93a4-c21198e5942a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.651170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.651771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.652059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.652337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.652969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.678798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.699445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1128/2262] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:36 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:36.703490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.713250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605a961-cb90-41a1-a826-2799958a2672 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.717481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.718071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.718362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.718640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.719363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.745906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.758523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1135/2263] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:36.762866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.772652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db9559-c471-4251-a215-5683b0e5124a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.777325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.778494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.778820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.779102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] PATH_INFO: `/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.799514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a941a05b39a145c98c66f2462d9ea891, user_id=24fd420347b64f75bebaca6c7f0294b0, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.826300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.838856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1129/2264] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:36 2022] PUT /identity/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:36.842714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.852953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0d85-467a-4382-b826-9f778a3d3ff0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.913373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.914497 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.914823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.915103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.915794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:36.941220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:36.951428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1136/2265] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:36.955489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:36.965481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079936b-b067-4c43-a09d-bee981eb7ce8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:36.969793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:36.970684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:36.971054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:36.971399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] PATH_INFO: `/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:36.973195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a941a05b39a145c98c66f2462d9ea891, user_id=24fd420347b64f75bebaca6c7f0294b0, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:37.000685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:37.015130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1130/2266] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:36 2022] PUT /identity/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:37.018903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:37.028462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a83f-2cad-424c-9452-88bba66640eb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:37.093511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:37.094108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:37.094398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:37.094690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:37.095394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:37.120779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f92d8-cea9-490f-b733-7b5215439e2f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:37.130861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1137/2267] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:37.135628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:37.145472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6256d9-ec72-47fc-b906-84de0918eab9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:37.150310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:37.151149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:37.151459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:37.151708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] PATH_INFO: `/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:37.153431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a941a05b39a145c98c66f2462d9ea891, user_id=24fd420347b64f75bebaca6c7f0294b0, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:37.180021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:37.192994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1131/2268] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:37 2022] PUT /identity/v3/projects/a941a05b39a145c98c66f2462d9ea891/users/24fd420347b64f75bebaca6c7f0294b0/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:37.204905 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:37.205196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:37.205476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:37.240985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] MFA Rules not processed for user `24fd420347b64f75bebaca6c7f0294b0`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:37.242649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:37.316292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1138/2269] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:37 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:37.327149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:37.328746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:37.392527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03528d79-e088-4944-b67e-3b77925cbcd2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:37.396373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:37.396962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:37.397250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:37.397528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:37.407379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:37.432849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6b4c4-aaa0-4f3a-89a5-bb05af82a079 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:37.442135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1132/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:37 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:37.869965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:37.938364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93af4f-8f37-43ff-8309-b5e2d6614194 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:37.942315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:37.943137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:37.943428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:37.943707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] PATH_INFO: `/v3/users/cbe0851b64654ac38c0b604fab7063a3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:37.945594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe0851b64654ac38c0b604fab7063a3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:37.971183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:38.022894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe0851b64654ac38c0b604fab7063a3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.029514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe0851b64654ac38c0b604fab7063a3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.030114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe0851b64654ac38c0b604fab7063a3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.030738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe0851b64654ac38c0b604fab7063a3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.040947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe0851b64654ac38c0b604fab7063a3'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.059036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1139/2271] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:37 2022] DELETE /identity/v3/users/cbe0851b64654ac38c0b604fab7063a3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:38.063595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:38.064064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:38.064180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:38.086692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:38.087838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:38.151432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1133/2272] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:38.161359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:38.162819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:38.227121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6261a-d68e-4a4b-b603-e732c9793001 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:38.230328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:38.230927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:38.231214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:38.231509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:38.239990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:38.265813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:38.275238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1140/2273] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:38.623234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:38.624811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:38.636575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6239a-6bf0-4c36-b466-a40fb5a681aa None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:38.641418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:38.642211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:38.642500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:38.642815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] PATH_INFO: `/v3/projects/915f87d297844ffab607e11194ce869b` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:38.643903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915f87d297844ffab607e11194ce869b)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:38.669310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:38.719626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915f87d297844ffab607e11194ce869b', 'request_id': 'req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.726178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915f87d297844ffab607e11194ce869b', 'request_id': 'req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.737078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915f87d297844ffab607e11194ce869b', 'request_id': 'req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.747173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] The token cache is being invalidate because project 915f87d297844ffab607e11194ce869b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:38.747453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.748046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.749435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1134/2274] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:38 2022] DELETE /identity/v3/projects/915f87d297844ffab607e11194ce869b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:38.753425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:38.763412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f142784-313d-4ec0-a015-89e86d73218a service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:38.824463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:38.825173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:38.825465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:38.825743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] PATH_INFO: `/v3/users/24fd420347b64f75bebaca6c7f0294b0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:38.826855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fd420347b64f75bebaca6c7f0294b0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:38.852603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:38.903471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fd420347b64f75bebaca6c7f0294b0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.910109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fd420347b64f75bebaca6c7f0294b0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.910719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fd420347b64f75bebaca6c7f0294b0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.911300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fd420347b64f75bebaca6c7f0294b0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.919367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e863bf1d-c719-4439-ab0e-55bb72a2c493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fd420347b64f75bebaca6c7f0294b0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:38.937092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1141/2275] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:38 2022] DELETE /identity/v3/users/24fd420347b64f75bebaca6c7f0294b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:39.299437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.300839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:39.315604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ed4c7-4575-45e0-8fa6-a089a846ff89 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.377392 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.378183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.378466 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.378842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] PATH_INFO: `/v3/projects/a941a05b39a145c98c66f2462d9ea891` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.379919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a941a05b39a145c98c66f2462d9ea891)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.406105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:39.454167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a941a05b39a145c98c66f2462d9ea891', 'request_id': 'req-fad741b8-adb4-4564-b6a7-cae990a73931'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:39.460962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a941a05b39a145c98c66f2462d9ea891', 'request_id': 'req-fad741b8-adb4-4564-b6a7-cae990a73931'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:39.472304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a941a05b39a145c98c66f2462d9ea891', 'request_id': 'req-fad741b8-adb4-4564-b6a7-cae990a73931'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:39.482513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] The token cache is being invalidate because project a941a05b39a145c98c66f2462d9ea891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:39.482856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:39.483457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-fad741b8-adb4-4564-b6a7-cae990a73931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:39.484849 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1135/2276] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:39 2022] DELETE /identity/v3/projects/a941a05b39a145c98c66f2462d9ea891 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:39.490189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.490691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.490798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.512945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:39.514092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:39.577101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1142/2277] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:39.584369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.584674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.584984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.607128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:39.608277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:39.619242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1136/2278] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:39.624866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.634727 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6e389-699a-4dda-a9ab-6a997c457b4d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.639103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.639686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.639979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.640262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.640986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:39.641288 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.666491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:39.679736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1143/2279] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:39.684017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.692681 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44c8b0-55ba-4d5c-9d0e-d92598a762c2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.697564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.698145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.698435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.698816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.699447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.724773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:39.751619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1137/2280] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:39 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:39.755611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.765403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a245c2-8926-441c-8eb4-7ad47e56f7f6 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.827060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.827660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.827951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.828230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.828858 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.854618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:39.875142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1144/2281] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:39 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:39.879183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.889518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fb6f2-970e-4128-82cf-1ec2944f899c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.893757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.894350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.894638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.894950 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.895640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.921528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bff97-0613-4148-92e7-d4354f1941a5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:39.932555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1138/2282] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:39.936767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:39.946514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c515f9-fe2e-410c-88e6-b7f262321315 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:39.950766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:39.951582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:39.951881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:39.952155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] PATH_INFO: `/v3/projects/7b0a0206fa4246b1b3d84bc743f2c574/users/7b255313abe84731bfadb7b5623f6e09/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:39.971591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0a0206fa4246b1b3d84bc743f2c574, user_id=7b255313abe84731bfadb7b5623f6e09, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:39.999179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.013887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1145/2283] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:39 2022] PUT /identity/v3/projects/7b0a0206fa4246b1b3d84bc743f2c574/users/7b255313abe84731bfadb7b5623f6e09/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:40.023982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.024279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.024565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.061583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] MFA Rules not processed for user `7b255313abe84731bfadb7b5623f6e09`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:40.062761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:40.134122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1139/2284] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:40 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:40.139102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.208930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ffacd-c2c4-4459-b006-37b8fab8af29 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.213507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.214169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.214460 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.214780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.215427 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.240800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.270873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1146/2285] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:40 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:40.272134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.282273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0f242-bf86-432c-a659-0eff50d958ee None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.344240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.344900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.345104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.345381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.346005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.371518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.391024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1140/2286] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:40 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:40.394981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.404711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bd719-dd8f-4aae-8200-4c94d2c0cbd4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.409258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.410253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.410543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.410867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.411568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.437663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.449928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1147/2287] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:40.454110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.463765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36be20-d096-4043-9a27-2adb805ad8d2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.467784 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.468590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.468880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.469160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] PATH_INFO: `/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.488950 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118bcfadef443f89127887445c67777, user_id=c362e2b5d7754992aeba063d22e4d066, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.516249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.528521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1141/2288] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:40 2022] PUT /identity/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:40.532425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.542803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39acb1-4cfe-4bbe-ae93-142f7ff9992b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.603403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.603984 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.604270 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.604547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.605231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.631141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.641345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1148/2289] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:40.645416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.654971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d174-2bdf-44a7-8484-264912ec49ff admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.659159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.659959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.660245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.660527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] PATH_INFO: `/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.662262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118bcfadef443f89127887445c67777, user_id=c362e2b5d7754992aeba063d22e4d066, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.689142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.699084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1142/2290] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:40 2022] PUT /identity/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:40.702819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.713060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5868-09aa-47fb-802d-0c2ae36874c4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.778053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.778572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.778891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.779177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.779902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.805876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a7ab-4de3-45e5-bfd9-2e1d7047df75 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.815778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1149/2291] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:40.820449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:40.830149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4793c-f59e-4bd4-add3-109f6713b469 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:40.834393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:40.835747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.836467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.836758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] PATH_INFO: `/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.838533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118bcfadef443f89127887445c67777, user_id=c362e2b5d7754992aeba063d22e4d066, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:40.865602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:40.879560 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1143/2292] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:40 2022] PUT /identity/v3/projects/7118bcfadef443f89127887445c67777/users/c362e2b5d7754992aeba063d22e4d066/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:40.891425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:40.891721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:40.892005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:40.928428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] MFA Rules not processed for user `c362e2b5d7754992aeba063d22e4d066`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:40.929572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:41.003924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1150/2293] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:40 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:41.013839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:41.015491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:41.080027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472de4b8-97d0-4b19-8091-00b22367fb2e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:41.083396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:41.083967 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:41.084256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:41.084537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:41.093660 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:41.119406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314ddf5-9898-42f4-b5e4-c4553b1b6268 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:41.128536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1144/2294] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:41 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:42.791733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:42.859861 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14c76e-cff2-4062-8953-d59ef3586fb4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:42.863898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:42.864679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:42.864962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:42.865234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] PATH_INFO: `/v3/users/7b255313abe84731bfadb7b5623f6e09` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:42.866316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b255313abe84731bfadb7b5623f6e09)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:42.892177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:42.938775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b255313abe84731bfadb7b5623f6e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:42.947963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b255313abe84731bfadb7b5623f6e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:42.948625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b255313abe84731bfadb7b5623f6e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:42.949206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b255313abe84731bfadb7b5623f6e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:42.957133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b255313abe84731bfadb7b5623f6e09'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:42.974652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1151/2295] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:42 2022] DELETE /identity/v3/users/7b255313abe84731bfadb7b5623f6e09 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:42.979450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:42.979921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:42.980120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:43.002473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:43.003682 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:43.072345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1145/2296] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:43.082416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:43.083765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:43.147605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed36e5-dce4-45c1-a473-3faa9e2692cf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:43.151059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:43.151633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:43.151922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:43.152197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:43.160701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:43.186045 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:43.195360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1152/2297] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:52:43.729038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:43.730413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:43.742224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353afb6-c3fe-4a7e-b982-fe4b9b98ac41 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:43.746586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:43.747408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:43.747697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:43.748050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] PATH_INFO: `/v3/projects/7b0a0206fa4246b1b3d84bc743f2c574` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:43.749137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0a0206fa4246b1b3d84bc743f2c574)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:43.775743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:43.826813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0a0206fa4246b1b3d84bc743f2c574', 'request_id': 'req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:43.833659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0a0206fa4246b1b3d84bc743f2c574', 'request_id': 'req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:43.845161 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0a0206fa4246b1b3d84bc743f2c574', 'request_id': 'req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:43.855433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] The token cache is being invalidate because project 7b0a0206fa4246b1b3d84bc743f2c574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:43.855715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:43.856332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:43.857754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1146/2298] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:43 2022] DELETE /identity/v3/projects/7b0a0206fa4246b1b3d84bc743f2c574 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:43.861755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:43.871403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705e1a-ea7a-43d4-add2-25d78fd9ddfd service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:43.955174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:43.956114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:43.956469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:43.956937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] PATH_INFO: `/v3/users/c362e2b5d7754992aeba063d22e4d066` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:43.958187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c362e2b5d7754992aeba063d22e4d066)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:43.985936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:44.040253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c362e2b5d7754992aeba063d22e4d066'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.046613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c362e2b5d7754992aeba063d22e4d066'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.047216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c362e2b5d7754992aeba063d22e4d066'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.047942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c362e2b5d7754992aeba063d22e4d066'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.058142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-dd9734ed-99e7-4c78-877c-297401beb814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c362e2b5d7754992aeba063d22e4d066'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.076352 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1153/2299] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:43 2022] DELETE /identity/v3/users/c362e2b5d7754992aeba063d22e4d066 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:44.435888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:44.437495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:44.450073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8b3b4-d27d-45e2-aca3-a21af79c3c3e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:44.515428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:44.516216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.516504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.516787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] PATH_INFO: `/v3/projects/7118bcfadef443f89127887445c67777` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.517900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7118bcfadef443f89127887445c67777)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:44.544629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:44.601189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7118bcfadef443f89127887445c67777', 'request_id': 'req-c1c32a06-c107-40c8-8970-bd927fdc286a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.609038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7118bcfadef443f89127887445c67777', 'request_id': 'req-c1c32a06-c107-40c8-8970-bd927fdc286a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.621948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7118bcfadef443f89127887445c67777', 'request_id': 'req-c1c32a06-c107-40c8-8970-bd927fdc286a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.632079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] The token cache is being invalidate because project 7118bcfadef443f89127887445c67777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:44.633069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.633796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c1c32a06-c107-40c8-8970-bd927fdc286a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:44.635202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1147/2300] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:44 2022] DELETE /identity/v3/projects/7118bcfadef443f89127887445c67777 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:44.643568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.643866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.644149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.667849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:44.669025 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:44.735134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1154/2301] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:44.743569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.743864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.744149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.766938 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:44.768117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:44.775274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1148/2302] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:44.780089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:44.789589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987cad5-9b7b-4e82-81af-03e07b3fa0e6 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:44.794384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:44.795012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.795297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.795576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.796315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:44.796582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:44.823206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:44.836678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1155/2303] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:44.840949 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:44.849594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a68b77-c9a6-4bb2-b3a7-9b0f49d3b403 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:44.854217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:44.854839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.855128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.855416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.856119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:44.883407 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:44.910801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1149/2304] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:44 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:44.915368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:44.925138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e95c9-f72c-4be2-8a57-0a98caac6502 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:44.993478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:44.994087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:44.994377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:44.994654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:44.995408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.023410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.044862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1156/2305] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:44 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:45.049203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.060147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c389a-4b12-4f80-92be-dd3ca58ffcf8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.064354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.064942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.065235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.065524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.066219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.091688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853984e-653a-4d7a-8d7a-886b9bfbe38d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.103015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1150/2306] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:45.107149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.117116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3e19-a33a-4c34-845e-7ddb3a806769 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.121299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.122102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.122390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.122691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] PATH_INFO: `/v3/projects/73b0645186814f65892fd74be844f232/users/e1ca3b5644584ac7b19984495177d736/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.141867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b0645186814f65892fd74be844f232, user_id=e1ca3b5644584ac7b19984495177d736, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.168358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.181732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1157/2307] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:45 2022] PUT /identity/v3/projects/73b0645186814f65892fd74be844f232/users/e1ca3b5644584ac7b19984495177d736/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:45.192502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.192801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.193086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.230958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] MFA Rules not processed for user `e1ca3b5644584ac7b19984495177d736`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:45.232126 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:45.306495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1151/2308] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:45 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:45.310937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.378189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd2ff3-b982-4075-bd11-ebd4fc7ebfcd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.382394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.383008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.383297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.383577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.384201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.410070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.435659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1158/2309] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:45 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:45.439556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.450097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae73fb-5f12-4fc6-89cb-5de8dcae14b9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.512548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.513142 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.513435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.513722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.514478 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.551724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.588602 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1152/2310] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:45 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:45.592582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.603030 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0152e9-80c9-4b68-be53-ef90cc06af7d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.607222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.607817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.608110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.608394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.609095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.634776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.645908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1159/2311] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:45.650523 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.659889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817f49-350f-49cd-966c-efedce98edb2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.664762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.665566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.665853 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.666133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] PATH_INFO: `/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.685461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ad963c034847afb7cc2c663c1adb50, user_id=4bdd2aa126c845989433797d729eab30, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.712032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.724339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1153/2312] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:45 2022] PUT /identity/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:45.728845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.738160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee04e-93f7-4dae-b95b-6e4eed6aa820 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.799579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.800195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.800483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.800762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.801454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.827527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.838107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1160/2313] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:45.842167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.853134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e8283-bbe9-41f8-a032-372c7df4df19 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.857669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.858497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.858817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.859095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] PATH_INFO: `/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.861116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ad963c034847afb7cc2c663c1adb50, user_id=4bdd2aa126c845989433797d729eab30, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:45.891410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.901969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1154/2314] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:45 2022] PUT /identity/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:45.905869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.917006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd752d-b795-4a73-8459-83df0e6b625b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.980237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.981057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.981355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.981640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.982450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.008584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7271ea8-94f6-45c6-a62e-0207b62cb525 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.019234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1161/2315] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:46.023922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.033467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ab3df-6b8e-4896-bf0d-bd4236572c01 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.037555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.039078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.039370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.039648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] PATH_INFO: `/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.041389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ad963c034847afb7cc2c663c1adb50, user_id=4bdd2aa126c845989433797d729eab30, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.070024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.084618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1155/2316] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:46 2022] PUT /identity/v3/projects/23ad963c034847afb7cc2c663c1adb50/users/4bdd2aa126c845989433797d729eab30/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:46.095453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.095751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.096037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.133923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] MFA Rules not processed for user `4bdd2aa126c845989433797d729eab30`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:46.135102 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.180995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.182631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.211431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1162/2317] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:46.222002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.223283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.257268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d64f-2a06-41cd-9de4-32efb5b970a8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.261714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.262537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.262854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.263132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.264782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.275856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.285543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d717-57d6-473d-856b-dbebde88a801 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.289363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.289931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.290215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.290491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.299027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.301387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.310826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1156/2318] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:46 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:52:46.323903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.333517 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1163/2319] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:46 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:52:46.668755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.678741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d75c-0ebe-47c6-9db2-8394a16c4958 service placement] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.683648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bdd2aa126c845989433797d729eab30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ad963c034847afb7cc2c663c1adb50', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.684244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.684545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.684836 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.685528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:46.685833 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.710918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.723608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1157/2320] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:46.728300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.737151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21a659-41ee-4eef-8535-83f5bf65377d service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.741561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bdd2aa126c845989433797d729eab30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ad963c034847afb7cc2c663c1adb50', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.742388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.742723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.743009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.744290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.771212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.798044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1164/2321] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:46 2022] POST /identity/v3/projects => generated 355 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:46.802185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.811642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfea11-b055-44d3-899e-e86e158bddec tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.874283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bdd2aa126c845989433797d729eab30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ad963c034847afb7cc2c663c1adb50', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.874916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.875217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.875508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.876205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:46.876512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.902473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.914821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1158/2322] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:46.951749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.961617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ba80-17dc-4eda-9a02-c5f9225eb907 tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.965764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bdd2aa126c845989433797d729eab30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23ad963c034847afb7cc2c663c1adb50', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.966554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.966873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.967159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] PATH_INFO: `/v3/projects/a5e34564c7fd4dbf90b82d53eedc30e6` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.968244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5e34564c7fd4dbf90b82d53eedc30e6)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:46.994388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.044986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e34564c7fd4dbf90b82d53eedc30e6', 'request_id': 'req-3f1436f6-a20f-4b92-b728-3d10dcdec4da'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.050136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e34564c7fd4dbf90b82d53eedc30e6', 'request_id': 'req-3f1436f6-a20f-4b92-b728-3d10dcdec4da'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.061444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e34564c7fd4dbf90b82d53eedc30e6', 'request_id': 'req-3f1436f6-a20f-4b92-b728-3d10dcdec4da'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.073334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] The token cache is being invalidate because project a5e34564c7fd4dbf90b82d53eedc30e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:47.073701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.074307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3f1436f6-a20f-4b92-b728-3d10dcdec4da tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.075867 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1165/2323] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:46 2022] DELETE /identity/v3/projects/a5e34564c7fd4dbf90b82d53eedc30e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:47.301744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.303380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.373745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bd73b-cb51-4ad7-a09a-8d70f434691b tempest-VolumeQuotaClassesTest-1453877650 tempest-VolumeQuotaClassesTest-1453877650-project-admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.434298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.435132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.435423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.435706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] PATH_INFO: `/v3/users/e1ca3b5644584ac7b19984495177d736` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.437433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ca3b5644584ac7b19984495177d736)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:47.464021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.511354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ca3b5644584ac7b19984495177d736'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.523714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ca3b5644584ac7b19984495177d736'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.524336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ca3b5644584ac7b19984495177d736'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.524921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ca3b5644584ac7b19984495177d736'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.532283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ca3b5644584ac7b19984495177d736'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:47.543927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1159/2324] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:47 2022] DELETE /identity/v3/users/e1ca3b5644584ac7b19984495177d736 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:47.548463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.548699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.549038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.571765 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:47.572943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.636706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1166/2325] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:47.647076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.648628 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.713340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa1e69-370d-4e68-b5c7-808d3e6d75be admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.716719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.717298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.717590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.717871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.726506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:47.751850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.761774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1160/2326] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:48.106846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.108223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:48.120267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ab2ae-581e-425f-bf6b-2bd8d7b12292 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.124580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.125365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.125653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.125933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] PATH_INFO: `/v3/projects/73b0645186814f65892fd74be844f232` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.127038 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b0645186814f65892fd74be844f232)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:48.153032 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.202248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b0645186814f65892fd74be844f232', 'request_id': 'req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.207290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b0645186814f65892fd74be844f232', 'request_id': 'req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.218192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b0645186814f65892fd74be844f232', 'request_id': 'req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.230829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] The token cache is being invalidate because project 73b0645186814f65892fd74be844f232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:48.231291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.231868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.233285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1167/2327] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:48 2022] DELETE /identity/v3/projects/73b0645186814f65892fd74be844f232 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:48.237200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.246857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86587f30-3982-49f2-b4ad-3ece271856fa service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.309299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.310099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.310389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.310695 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] PATH_INFO: `/v3/users/4bdd2aa126c845989433797d729eab30` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.311782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdd2aa126c845989433797d729eab30)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:48.337654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.384483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdd2aa126c845989433797d729eab30'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.396401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdd2aa126c845989433797d729eab30'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.397067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdd2aa126c845989433797d729eab30'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.398167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdd2aa126c845989433797d729eab30'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.405882 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1429d3f2-2367-44cd-956a-f3f2056ce57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdd2aa126c845989433797d729eab30'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.419367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1161/2328] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:48 2022] DELETE /identity/v3/users/4bdd2aa126c845989433797d729eab30 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:48.839068 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.840505 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:48.854225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d4ed4-7c21-4cfe-b6f1-e9d69243d1d0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.918900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.919605 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.919894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.920171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] PATH_INFO: `/v3/projects/23ad963c034847afb7cc2c663c1adb50` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.921246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ad963c034847afb7cc2c663c1adb50)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:48.946899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.995959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ad963c034847afb7cc2c663c1adb50', 'request_id': 'req-3cc4c885-7817-4ab0-b641-9986b40c0871'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.000874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ad963c034847afb7cc2c663c1adb50', 'request_id': 'req-3cc4c885-7817-4ab0-b641-9986b40c0871'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.012865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ad963c034847afb7cc2c663c1adb50', 'request_id': 'req-3cc4c885-7817-4ab0-b641-9986b40c0871'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.024829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] The token cache is being invalidate because project 23ad963c034847afb7cc2c663c1adb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:49.025110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.025699 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3cc4c885-7817-4ab0-b641-9986b40c0871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.027299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1168/2329] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:48 2022] DELETE /identity/v3/projects/23ad963c034847afb7cc2c663c1adb50 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:49.032183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.032632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.032741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.057000 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:49.058144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:49.121757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1162/2330] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:49.129402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.129860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.129980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.152412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:49.153582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:49.160479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1169/2331] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:49.165194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.174230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b38e5-ad4f-4a4f-89c2-c9b7b495eb98 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.178299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.178934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.179220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.179498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.180181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:49.180477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.205674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.219110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1163/2332] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:52:49.223363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.232700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a68248-f627-4937-839a-030656e5bbc9 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.236973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.237546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.237862 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.238142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.238826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.264261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.291936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1170/2333] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:49.296093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.305987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1e45-ab3c-45a1-96bd-a9c9264ee8e2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.367571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.368170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.368457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.368735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.369359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.394992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.415286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1164/2334] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:49.419514 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.429693 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be9b0-85e3-4d5b-af20-d697d414334f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.433903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.434499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.434824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.435107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.435820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.461437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81851a75-fdf9-4b04-935b-b27d5511e787 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.471379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1171/2335] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:52:49.475362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.485456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdad0f-3e08-46e1-a7ad-2f170eed42bc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.489583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.490386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.490683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.490999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] PATH_INFO: `/v3/projects/f85862568f7f43a58f6bb395874ebd92/users/1a438839a7f143d8bf29b870024a937b/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.510619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85862568f7f43a58f6bb395874ebd92, user_id=1a438839a7f143d8bf29b870024a937b, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.537570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.550258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1165/2336] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:49 2022] PUT /identity/v3/projects/f85862568f7f43a58f6bb395874ebd92/users/1a438839a7f143d8bf29b870024a937b/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:49.561341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.561638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.561924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.597666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] MFA Rules not processed for user `1a438839a7f143d8bf29b870024a937b`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:49.598831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:49.668714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1172/2337] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:49.673115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.741072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b5dd-6eb2-42d3-8927-2c56aebc9d13 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.745479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.746063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.746355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.746641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.747315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.773959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.798540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1166/2338] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:49.802475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.812555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111badfb-d1b1-4a9d-b8b0-6ee2f046e576 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.874336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.874971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.875261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.875566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.876198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.902440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.920717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1173/2339] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:49 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:49.924656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.935140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854f525-babd-4769-b8b0-af2739365af5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.939332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.940760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.940760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.940760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.941155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:49.966649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.977926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1167/2340] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:52:49.982046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.992091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d8436-db50-40ad-977f-f6c24b46dc12 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.996428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.997238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.997532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.997812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] PATH_INFO: `/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.018169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7c3ee800674d45a9c66ad6ec7268a3, user_id=0185b5f12a154352afb336e85578d209, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.044752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.058520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1174/2341] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:49 2022] PUT /identity/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:50.062419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.072430 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c7a02-6c6f-4adc-9874-bfd31f2c1238 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.133519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.134174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.134465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.134772 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.135460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.160759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.170863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1168/2342] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:50.174982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.185371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f23bb-7224-4e76-9d8a-36080cf4842e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.189503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.190308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.190591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.190894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] PATH_INFO: `/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.192625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7c3ee800674d45a9c66ad6ec7268a3, user_id=0185b5f12a154352afb336e85578d209, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.219759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.230393 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1175/2343] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:50 2022] PUT /identity/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:50.234247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.244572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad639c-cde0-4d25-b094-f0d0d8965185 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.306318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.306934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.307222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.307502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.308468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.333942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4669a3-528c-4e20-aac5-a33137ed117e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.344470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1169/2344] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:50.348570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.358403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08442c-34d0-47e2-90da-4d44279ef4de admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.362596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.363432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.363719 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.363998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] PATH_INFO: `/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.365725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7c3ee800674d45a9c66ad6ec7268a3, user_id=0185b5f12a154352afb336e85578d209, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.392596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.407734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1176/2345] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:50 2022] PUT /identity/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3/users/0185b5f12a154352afb336e85578d209/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:50.417819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.418117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.418433 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.454249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] MFA Rules not processed for user `0185b5f12a154352afb336e85578d209`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:50.455428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:50.529465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1170/2346] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:50.539244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.540803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:50.603671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7daf673-3047-46ce-8ca2-4573c5c92700 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.607012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.607585 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.607874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.608156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.616697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.641831 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.651310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1177/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:50.739547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.748901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d30f15-37df-449d-b476-aa695981c1d2 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.752317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.752892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.753208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.753491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.816965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:50.842645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80996b2-d5c7-4579-a4ce-819a7ba32e56 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.851494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1171/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:53.639186 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.706891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14de4c-c602-4514-b276-6cedbdb07185 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.711314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.712110 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.712400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.712682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] PATH_INFO: `/v3/users/1a438839a7f143d8bf29b870024a937b` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.713755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a438839a7f143d8bf29b870024a937b)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:53.739128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.786788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a438839a7f143d8bf29b870024a937b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.792688 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a438839a7f143d8bf29b870024a937b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.793293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a438839a7f143d8bf29b870024a937b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.793869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a438839a7f143d8bf29b870024a937b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.801299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a438839a7f143d8bf29b870024a937b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.818298 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1178/2349] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:53 2022] DELETE /identity/v3/users/1a438839a7f143d8bf29b870024a937b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:53.823619 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.824104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.824204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.847336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:53.848494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.912215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1172/2350] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:53.922089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.923417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.987892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba908-ae3d-4e30-8050-51a8d51b4d8d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.992124 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.992698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.992983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.993258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:54.001996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:54.027734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:54.037053 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1179/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:54.378267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:54.379640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:54.390879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802c6c2-7e36-49d2-b588-b20769aeade9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:54.394843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:54.395644 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:54.395931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:54.396206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] PATH_INFO: `/v3/projects/f85862568f7f43a58f6bb395874ebd92` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:54.397259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85862568f7f43a58f6bb395874ebd92)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:54.423230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:54.473059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85862568f7f43a58f6bb395874ebd92', 'request_id': 'req-827d4efe-c86f-4c66-8dda-1317fb682c7f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.479735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85862568f7f43a58f6bb395874ebd92', 'request_id': 'req-827d4efe-c86f-4c66-8dda-1317fb682c7f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.490480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85862568f7f43a58f6bb395874ebd92', 'request_id': 'req-827d4efe-c86f-4c66-8dda-1317fb682c7f'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.500518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] The token cache is being invalidate because project f85862568f7f43a58f6bb395874ebd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:54.500800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.501393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.502822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1173/2352] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:54 2022] DELETE /identity/v3/projects/f85862568f7f43a58f6bb395874ebd92 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:54.507518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:54.517040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fca2f-9227-40dc-b4a7-7b04f1ea8a9d service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:54.581988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:54.582833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:54.583125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:54.583408 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] PATH_INFO: `/v3/users/0185b5f12a154352afb336e85578d209` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:54.584503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0185b5f12a154352afb336e85578d209)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:54.610080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:54.663054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0185b5f12a154352afb336e85578d209'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.670910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0185b5f12a154352afb336e85578d209'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.671531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0185b5f12a154352afb336e85578d209'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.672091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0185b5f12a154352afb336e85578d209'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.680739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3df3cb5d-abd1-485c-9399-00c87f7dde34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0185b5f12a154352afb336e85578d209'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:54.698318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1180/2353] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:54 2022] DELETE /identity/v3/users/0185b5f12a154352afb336e85578d209 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:55.047467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.048975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:55.064559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4efe-c86f-4c66-8dda-1317fb682c7f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.125638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.126432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.126752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.127038 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] PATH_INFO: `/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.128118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7c3ee800674d45a9c66ad6ec7268a3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.154568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.203121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7c3ee800674d45a9c66ad6ec7268a3', 'request_id': 'req-0dc804db-1fed-41b3-b301-9a05ac152044'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:55.209726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7c3ee800674d45a9c66ad6ec7268a3', 'request_id': 'req-0dc804db-1fed-41b3-b301-9a05ac152044'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:55.220961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7c3ee800674d45a9c66ad6ec7268a3', 'request_id': 'req-0dc804db-1fed-41b3-b301-9a05ac152044'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:55.230488 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] The token cache is being invalidate because project 1b7c3ee800674d45a9c66ad6ec7268a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:55.230789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:55.231388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0dc804db-1fed-41b3-b301-9a05ac152044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:55.232797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1174/2354] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:55 2022] DELETE /identity/v3/projects/1b7c3ee800674d45a9c66ad6ec7268a3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:55.237657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.237958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.238265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.261622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:55.263046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:55.328252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1181/2355] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:55.336171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.336464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.336744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.358614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:55.359788 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:55.367293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1175/2356] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:55.371477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.380673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2c40-a580-4480-a7e6-953261762dc5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.385436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.386052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.386343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.386628 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.387627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:52:55.387930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.412977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.425511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1182/2357] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:55.430381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.439115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bbdc-58b5-4027-be9d-b7573fd72e04 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.443399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.443981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.444986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.445317 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.445966 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.471316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.498575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1176/2358] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:55.504523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.514453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c473bc7-63a4-4ae5-8319-02816ae2bed1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.575326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.575921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.576210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.576488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.577130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.602983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.622491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1183/2359] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:55.626654 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.636587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84315-1a55-4eff-8483-f79ea4ca3df8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.641098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.641691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.641981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.642264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.643014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.668896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d002da-c9e6-46c1-9d7f-c67ace9536e7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.679826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1177/2360] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:55.683920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.693451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc52e-fed2-4828-acb7-693fa353520e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.698133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.698967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.699253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.699528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] PATH_INFO: `/v3/projects/325bd7acc0994604affc41db81c8ede0/users/4be792694db84512b835df56d68c8db3/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.719113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] RBAC: Authorizing `identity:create_grant(project_id=325bd7acc0994604affc41db81c8ede0, user_id=4be792694db84512b835df56d68c8db3, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.746400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:55.758806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1184/2361] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:55 2022] PUT /identity/v3/projects/325bd7acc0994604affc41db81c8ede0/users/4be792694db84512b835df56d68c8db3/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:55.768824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.769119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.769401 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.807187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] MFA Rules not processed for user `4be792694db84512b835df56d68c8db3`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:55.808436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:55.878932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1178/2362] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:55.883933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:55.950369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7952a57-854c-4e08-a13c-a88ef86f708d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:55.954544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:55.955232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:55.955526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:55.955802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:55.956440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:55.982944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.007927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1185/2363] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:55 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:56.012144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.023097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42098483-5c2c-4af3-be91-3365b86866aa None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.084437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.085872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.086018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.086163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.086843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.112776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.132067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1179/2364] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:56 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:56.136125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.146220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9bfbb-901e-4905-aa48-23b452a192e5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.151065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.151658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.151950 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.152233 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.152924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.178783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.189670 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1186/2365] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:56.193590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.203106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3533-5eda-41e4-9040-406200dca748 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.207277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.208081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.208374 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.208661 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] PATH_INFO: `/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.229475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40fc13b2fef47bfb39ac4c9a656565e, user_id=aa61ee8f5c9d4f28b89cd35188299b3b, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.255771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.269044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1180/2366] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:56 2022] PUT /identity/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:56.273654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.283131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0c96-abca-4bab-83cc-8b80907b8cbb admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.344764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.345353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.345640 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.345923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.346613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.371692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.381494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1187/2367] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:52:56.386232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.396104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef345-d678-4e29-8840-2e1bcf05f374 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.401092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.401899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.402183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.402479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] PATH_INFO: `/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.404257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40fc13b2fef47bfb39ac4c9a656565e, user_id=aa61ee8f5c9d4f28b89cd35188299b3b, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.430921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.440786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1181/2368] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:56 2022] PUT /identity/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:56.445049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.454442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b368-41f8-4d68-9990-91fbd7538603 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.517962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.518555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.518869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.519207 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.519839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.545260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c05d7-6289-4933-869e-59dec47ba96a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.558557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1188/2369] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:56.560557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.571291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce545b-1efb-41e7-8afc-5b14d8989739 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.575471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.576282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.576568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.576846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] PATH_INFO: `/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.578583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40fc13b2fef47bfb39ac4c9a656565e, user_id=aa61ee8f5c9d4f28b89cd35188299b3b, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.605543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.619572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1182/2370] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:56 2022] PUT /identity/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e/users/aa61ee8f5c9d4f28b89cd35188299b3b/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:56.629574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.629871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.630152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.665685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] MFA Rules not processed for user `aa61ee8f5c9d4f28b89cd35188299b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:56.666848 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:56.739335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1189/2371] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:52:56 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:56.749427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:56.751044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:56.814582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5036447-1197-48f9-ad6e-1cd0e3a3d1ec admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:56.817928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:56.818501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:56.818830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:56.819238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:56.880516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:52:56.906322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:56.915040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1183/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:56 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:53:01.522964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:01.524391 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:01.535724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd073752-b661-48ae-9175-c605d6c6d483 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:01.539682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:01.540256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:01.540543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:01.540820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:01.549537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:01.575578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162d83a-2cce-4d53-a85e-c46940e3f1a5 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:01.585823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1190/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:01 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:53:06.861191 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:06.930913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8bbaa-a890-49e0-8c73-b34b3b9d3c27 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:06.935014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:06.935800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:06.936085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:06.936368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] PATH_INFO: `/v3/users/4be792694db84512b835df56d68c8db3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:06.937440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be792694db84512b835df56d68c8db3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:06.964041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:07.011203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be792694db84512b835df56d68c8db3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.023669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be792694db84512b835df56d68c8db3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.024314 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be792694db84512b835df56d68c8db3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.024900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be792694db84512b835df56d68c8db3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.032358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be792694db84512b835df56d68c8db3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.044857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1184/2374] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:06 2022] DELETE /identity/v3/users/4be792694db84512b835df56d68c8db3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:07.049277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:07.049855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:07.049855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:07.072785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:07.073871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:07.136687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1191/2375] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:07.146718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:07.148259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:07.211558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f4362-20f5-4768-bd3c-83ac91106eb8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:07.214899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:07.215504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:07.215793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:07.216073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:07.225190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:07.250649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:07.261091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1185/2376] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:07.712299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:07.713821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:07.724882 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f51b2b-0a7b-46ae-bba0-5fac82208bda None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:07.729123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:07.729917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:07.730210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:07.730491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] PATH_INFO: `/v3/projects/325bd7acc0994604affc41db81c8ede0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:07.731687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325bd7acc0994604affc41db81c8ede0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:07.758864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:07.811192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325bd7acc0994604affc41db81c8ede0', 'request_id': 'req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.816417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325bd7acc0994604affc41db81c8ede0', 'request_id': 'req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.828535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325bd7acc0994604affc41db81c8ede0', 'request_id': 'req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.842194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] The token cache is being invalidate because project 325bd7acc0994604affc41db81c8ede0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:07.842458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.843092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:07.844718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1192/2377] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:07 2022] DELETE /identity/v3/projects/325bd7acc0994604affc41db81c8ede0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:07.851137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:07.860872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd41b-04f4-480a-b6a7-3540c5809c02 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:07.924987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:07.925793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:07.926085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:07.926372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] PATH_INFO: `/v3/users/aa61ee8f5c9d4f28b89cd35188299b3b` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:07.927483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa61ee8f5c9d4f28b89cd35188299b3b)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:07.954236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:08.005220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa61ee8f5c9d4f28b89cd35188299b3b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.019302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa61ee8f5c9d4f28b89cd35188299b3b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.020352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa61ee8f5c9d4f28b89cd35188299b3b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.020824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa61ee8f5c9d4f28b89cd35188299b3b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.029070 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c34742e9-0369-440d-b1d9-ba512299b7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa61ee8f5c9d4f28b89cd35188299b3b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.041903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1186/2378] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:07 2022] DELETE /identity/v3/users/aa61ee8f5c9d4f28b89cd35188299b3b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:08.492097 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:08.494600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:08.506242 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d0fac-1884-4ebc-b2c2-42231bf7c020 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:08.570951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:08.571750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:08.572042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:08.572341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] PATH_INFO: `/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:08.573464 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40fc13b2fef47bfb39ac4c9a656565e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:08.601922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:08.653212 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40fc13b2fef47bfb39ac4c9a656565e', 'request_id': 'req-d06697b1-dcdb-4791-827e-17a0ae53aa30'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.658878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40fc13b2fef47bfb39ac4c9a656565e', 'request_id': 'req-d06697b1-dcdb-4791-827e-17a0ae53aa30'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.670476 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40fc13b2fef47bfb39ac4c9a656565e', 'request_id': 'req-d06697b1-dcdb-4791-827e-17a0ae53aa30'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.683275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] The token cache is being invalidate because project c40fc13b2fef47bfb39ac4c9a656565e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:08.683493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.684096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-d06697b1-dcdb-4791-827e-17a0ae53aa30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:08.685600 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1193/2379] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:08 2022] DELETE /identity/v3/projects/c40fc13b2fef47bfb39ac4c9a656565e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:08.691537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:08.691832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:08.692121 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:08.715027 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:08.716180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:08.781114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1187/2380] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:08.790356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:08.790656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:08.790993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:08.814027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:08.815240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:08.823039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1194/2381] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:08.827276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:08.836874 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5df82-672e-42e8-8797-552ded4fab06 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:08.841167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:08.841756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:08.842062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:08.842340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:08.843073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:53:08.843377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:08.870014 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:08.885198 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1188/2382] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:53:08.889959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:08.898829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcdeb3-56c5-4c65-8f73-469ee014d2b1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:08.903084 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:08.903663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:08.903953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:08.904234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:08.904884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:08.930927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:08.958475 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1195/2383] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:53:08 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:53:08.962745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:08.972073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab63d0-0346-4089-aa9c-739323cc1ffc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.035857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.036453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.036741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.037021 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.038244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.065814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.085002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1189/2384] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:53:08 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:53:09.088998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:09.099216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab8cfe-bff5-4024-a959-e44e4c6d1696 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.103942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.104529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.104816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.105095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.105783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.131633 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037e79a-b8c7-48f4-b950-96551823712d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.142236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1196/2385] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:53:09.146566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:09.156297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03be114-bed7-41d7-a478-6129b811fe93 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.160530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.161395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.161682 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.161961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] PATH_INFO: `/v3/projects/e43b6083bec842cbb6392d1d1c93a3a5/users/18db588ed583423bbaea0e6a92010206/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.183941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b6083bec842cbb6392d1d1c93a3a5, user_id=18db588ed583423bbaea0e6a92010206, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.211222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.224630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1190/2386] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:53:09 2022] PUT /identity/v3/projects/e43b6083bec842cbb6392d1d1c93a3a5/users/18db588ed583423bbaea0e6a92010206/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:09.236362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.236732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.237117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.276054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] MFA Rules not processed for user `18db588ed583423bbaea0e6a92010206`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:09.277214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:09.347742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1197/2387] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:09.358442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:09.360063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:09.424632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed210a7-23f8-47fe-a89e-9cdcfd3ac90a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.427953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.428552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.428839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.429120 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.437252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.462896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ace9e-cdec-4671-80da-97d9cb6b16b2 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.471207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1191/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:09 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:09.491154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:09.561051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1e6c-f79d-4474-9bc6-e5bd5b3e1190 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.565247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.566047 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.566334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.566614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] PATH_INFO: `/v3/users/18db588ed583423bbaea0e6a92010206` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.567732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18db588ed583423bbaea0e6a92010206)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.595196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.655237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18db588ed583423bbaea0e6a92010206'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:09.663771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18db588ed583423bbaea0e6a92010206'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:09.664506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18db588ed583423bbaea0e6a92010206'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:09.665292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18db588ed583423bbaea0e6a92010206'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:09.673538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18db588ed583423bbaea0e6a92010206'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:09.697880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1198/2389] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:09 2022] DELETE /identity/v3/users/18db588ed583423bbaea0e6a92010206 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:09.699554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.699846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.700132 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.723582 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:09.724877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:09.797597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1192/2390] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:09.808103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:09.809528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:09.880757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53181303-54e7-4969-98ed-2993fc9f9a03 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:09.884404 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:09.885004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:09.885293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:09.885572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:09.895870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:09.921609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978f3e6-0c82-4e72-a529-a85cfc06df34 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:09.932648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1199/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:10.376211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:10.377701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:10.390309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467a4a5-2573-4206-bdb3-326cfa43576e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:10.395098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:10.396112 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.396481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.396807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] PATH_INFO: `/v3/projects/e43b6083bec842cbb6392d1d1c93a3a5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.398244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43b6083bec842cbb6392d1d1c93a3a5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:10.423769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:10.477264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43b6083bec842cbb6392d1d1c93a3a5', 'request_id': 'req-42bf0ee9-c929-43e5-a122-8e2465c9cef8'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:10.484503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43b6083bec842cbb6392d1d1c93a3a5', 'request_id': 'req-42bf0ee9-c929-43e5-a122-8e2465c9cef8'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:10.496883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43b6083bec842cbb6392d1d1c93a3a5', 'request_id': 'req-42bf0ee9-c929-43e5-a122-8e2465c9cef8'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:10.509177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] The token cache is being invalidate because project e43b6083bec842cbb6392d1d1c93a3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:10.509335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:10.509973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-42bf0ee9-c929-43e5-a122-8e2465c9cef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:10.511873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1193/2392] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:10 2022] DELETE /identity/v3/projects/e43b6083bec842cbb6392d1d1c93a3a5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:10.516791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.517137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.517423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.541730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:10.542916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:10.607859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1200/2393] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:10.615276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.615573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.616707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.638780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:10.639929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:10.646918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1194/2394] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:10.651176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:10.660096 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f89aa-a8ad-46b0-9f95-7458ff3aad8b None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:10.664846 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:10.665431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.665745 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.666026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.666752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:53:10.667051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:10.692482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:10.706317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1201/2395] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:53:10.710854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:10.719794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d602-74f7-4247-b292-f2d2e7153244 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:10.724299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:10.724881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.725689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.726133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.726814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:10.752806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:10.784064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1195/2396] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:53:10 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:53:10.785080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:10.795456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378777-89b0-453e-a458-4aaaa30f0ce1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:10.865021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:10.865704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.866000 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.866286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.867042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:10.895269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:10.930714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1202/2397] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:53:10 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:53:10.931907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:10.962923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965665-8c1c-46cd-80d9-f09a834e9e11 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:10.983419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:10.984405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:10.984935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:10.985443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:10.986377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:11.044365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680302b-2127-4df7-98ee-43abddd03215 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:11.072696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1196/2398] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:53:11.073617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:11.087258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79c41-3824-4c43-808d-6673c5346e8b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:11.092020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:11.093465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.093855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.094234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] PATH_INFO: `/v3/projects/219e18bd7d944eea8b65a6e2e7a9ee8c/users/119fabc6d9cc4066bd1002c793102e62/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.119154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219e18bd7d944eea8b65a6e2e7a9ee8c, user_id=119fabc6d9cc4066bd1002c793102e62, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:11.148285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:11.167925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1203/2399] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:53:11 2022] PUT /identity/v3/projects/219e18bd7d944eea8b65a6e2e7a9ee8c/users/119fabc6d9cc4066bd1002c793102e62/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:11.239623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.240003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.240207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.281741 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] MFA Rules not processed for user `119fabc6d9cc4066bd1002c793102e62`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:11.282946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:11.373092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1197/2400] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:11 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:11.384594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:11.386255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:11.493236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecba8f-bcdc-4f33-b99d-4099275bf6b5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:11.497402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:11.498103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.498987 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.499380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.510860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:11.539061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b27838-dc4f-460c-9113-118deede4156 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:11.549320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1204/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:11 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:11.583238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:11.667106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf0ab-2097-4790-b3c6-74d57066e51c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:11.672763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:11.673688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.674087 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.674470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] PATH_INFO: `/v3/users/119fabc6d9cc4066bd1002c793102e62` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.675804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=119fabc6d9cc4066bd1002c793102e62)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:11.713899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:11.766854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119fabc6d9cc4066bd1002c793102e62'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:11.778959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119fabc6d9cc4066bd1002c793102e62'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:11.779712 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119fabc6d9cc4066bd1002c793102e62'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:11.780592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119fabc6d9cc4066bd1002c793102e62'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:11.788513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119fabc6d9cc4066bd1002c793102e62'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:11.800482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1198/2402] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:11 2022] DELETE /identity/v3/users/119fabc6d9cc4066bd1002c793102e62 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:11.805611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.806150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.806150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.828560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:11.829725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:11.897377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1205/2403] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:11.907608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:11.909003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:11.972603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368ec30-f367-4312-af4c-99088ef6a75c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:11.976278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:11.976857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:11.977146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:11.977427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:11.994082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:12.026429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fb95d-786a-4590-8aea-b731b58fe1ac service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:12.036915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1199/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:12.456238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:12.457725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:12.469853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8956e8-fe1a-49b7-96a6-5cb2cbe75f14 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:12.474309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:12.475838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:12.476237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:12.476522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] PATH_INFO: `/v3/projects/219e18bd7d944eea8b65a6e2e7a9ee8c` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:12.477653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219e18bd7d944eea8b65a6e2e7a9ee8c)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:12.503418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:12.644350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219e18bd7d944eea8b65a6e2e7a9ee8c', 'request_id': 'req-5506804b-ced7-444a-8beb-82361fced648'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:12.651206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219e18bd7d944eea8b65a6e2e7a9ee8c', 'request_id': 'req-5506804b-ced7-444a-8beb-82361fced648'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:12.666430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219e18bd7d944eea8b65a6e2e7a9ee8c', 'request_id': 'req-5506804b-ced7-444a-8beb-82361fced648'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:12.683448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] The token cache is being invalidate because project 219e18bd7d944eea8b65a6e2e7a9ee8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:12.683735 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:12.684454 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5506804b-ced7-444a-8beb-82361fced648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:12.686362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1206/2405] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:12 2022] DELETE /identity/v3/projects/219e18bd7d944eea8b65a6e2e7a9ee8c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:12.691370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:12.691911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:12.692219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:12.718941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:12.720438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:12.792581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1200/2406] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:12.800315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:12.800617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:12.800938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:12.823962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:12.825126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:12.832194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1207/2407] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:12.837019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:12.846241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b517fed-62f1-4f81-a009-d455fa40d043 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:12.850633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:12.851331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:12.851623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:12.851907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:12.852599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:53:12.852930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:12.878029 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:12.892300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1201/2408] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:53:12.896445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:12.906099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cde9b2-545c-4577-9082-c4c1f329cb14 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:12.910244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:12.910855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:12.911141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:12.911421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:12.912051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:12.937822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:12.967407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1208/2409] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:53:12 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:53:12.971233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:12.981820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5dad-f935-47cf-bedf-99b63525e325 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:13.057672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:13.058273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:13.058561 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:13.058865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:13.059518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:13.086155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:13.105023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1202/2410] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:53:12 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:53:13.109285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:13.119653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4011-16f1-431b-98b7-ad8be222fc5a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:13.123944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:13.124541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:13.124827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:13.125103 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:13.125791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:13.153414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da675e79-56fe-4e89-9194-dda1e2ae2824 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:13.164879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1209/2411] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:53:13.169151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:13.179450 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99901-15b3-45f0-bbd3-cf3ed17ffb9b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:13.183720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:13.184527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:13.184819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:13.185104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] PATH_INFO: `/v3/projects/24de028adc9147a4a3878a0d84dfd168/users/9dca5e68a5964092bf0d64eeeb545ecb/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:13.204851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24de028adc9147a4a3878a0d84dfd168, user_id=9dca5e68a5964092bf0d64eeeb545ecb, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:13.230933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:13.243735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1203/2412] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:53:13 2022] PUT /identity/v3/projects/24de028adc9147a4a3878a0d84dfd168/users/9dca5e68a5964092bf0d64eeeb545ecb/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:13.254292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc239-7a98-4100-b2bb-30ae14ed120a None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:13.254608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc239-7a98-4100-b2bb-30ae14ed120a None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:13.254921 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cc239-7a98-4100-b2bb-30ae14ed120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:13.290480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-821cc239-7a98-4100-b2bb-30ae14ed120a None None] MFA Rules not processed for user `9dca5e68a5964092bf0d64eeeb545ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:13.291593 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-821cc239-7a98-4100-b2bb-30ae14ed120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:13.360165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1210/2413] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:13 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:13.373590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:13.375243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:13.439479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350601ae-6b7d-413a-9b4e-7d773572f39e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:13.442901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c47875086994711af245d3b53b617f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:13.443481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:13.444393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:13.444677 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:13.453077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:13.478857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:13.487423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1204/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:13 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:16.228759 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451adeb-170c-4959-8a7d-2584b9cf9e6c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:16.229304 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451adeb-170c-4959-8a7d-2584b9cf9e6c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:16.229414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451adeb-170c-4959-8a7d-2584b9cf9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:16.252623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c451adeb-170c-4959-8a7d-2584b9cf9e6c None None] MFA Rules not processed for user `e2a88a8d7c9e4d0a88308c0e894570be`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:16.253943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c451adeb-170c-4959-8a7d-2584b9cf9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:16.316774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1211/2415] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:16 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:37.384348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:37.452804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a8817-8902-4f84-8237-b68cdc2a3b4b service glance] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:37.456913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:37.457703 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:37.457989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:37.458265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] PATH_INFO: `/v3/users/9dca5e68a5964092bf0d64eeeb545ecb` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:37.459982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dca5e68a5964092bf0d64eeeb545ecb)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:37.486299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:37.535030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dca5e68a5964092bf0d64eeeb545ecb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:37.546805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dca5e68a5964092bf0d64eeeb545ecb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:37.547428 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dca5e68a5964092bf0d64eeeb545ecb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:37.547998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dca5e68a5964092bf0d64eeeb545ecb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:37.555505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dca5e68a5964092bf0d64eeeb545ecb'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:37.567422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1205/2416] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:37 2022] DELETE /identity/v3/users/9dca5e68a5964092bf0d64eeeb545ecb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:37.572724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:37.573290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:37.573290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:37.596789 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:37.597939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:37.659753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1212/2417] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:37.670970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:37.672296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:37.737043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50b3c-87de-434a-bddb-c11170020ae7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:37.740637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:37.741216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:37.741507 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:37.741790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:37.750563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:37.777412 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eeccf-4500-4b99-b712-942694a4c777 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:37.787501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1206/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:38.378526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:38.380153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:38.393402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713d4f8-7903-4dd0-bb2f-d2259b03862c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:38.398827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:38.399647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:38.399938 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:38.400243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] PATH_INFO: `/v3/projects/24de028adc9147a4a3878a0d84dfd168` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:38.401312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24de028adc9147a4a3878a0d84dfd168)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:53:38.428010 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:38.479344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24de028adc9147a4a3878a0d84dfd168', 'request_id': 'req-3be754e6-5834-438e-af29-c3ac02d5215d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:38.485993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24de028adc9147a4a3878a0d84dfd168', 'request_id': 'req-3be754e6-5834-438e-af29-c3ac02d5215d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:38.497634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24de028adc9147a4a3878a0d84dfd168', 'request_id': 'req-3be754e6-5834-438e-af29-c3ac02d5215d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:38.509787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] The token cache is being invalidate because project 24de028adc9147a4a3878a0d84dfd168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:38.510071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:38.510652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-3be754e6-5834-438e-af29-c3ac02d5215d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:38.512241 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1213/2419] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:38 2022] DELETE /identity/v3/projects/24de028adc9147a4a3878a0d84dfd168 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:54:09.718900 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:09.719501 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:09.719612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:09.746144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] MFA Rules not processed for user `b68bc45984974d6da1c9151c21dae14c`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:09.747451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:09.815343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1207/2420] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:54:09 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:17.294603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:17.295166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:17.295489 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:17.326690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:17.327891 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:17.393283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1214/2421] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:17.436178 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:17.438063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:17.592935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652bfff-9575-42bf-8f5e-8a8a6b86e135 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:17.597618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:17.598195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:17.598490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:17.598811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:17.607187 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:17.633795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:17.642046 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1208/2422] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:54:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:33.317722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:33.319982 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:33.382942 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bc07-deb5-44b8-a1eb-afbc81908a03 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:33.386131 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:33.386731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:33.387019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:33.387297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:33.389205 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:33.471034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:33.498377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cb29b-9f52-4ec2-92d5-41f29cebd7e3 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:33.511220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1215/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:33 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:35.528527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:35.530344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:35.599674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b996e-ea3f-4453-8b27-31ed15575757 service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:35.604667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:35.605257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:35.605555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:35.605843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:35.607606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:35.623028 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:35.664041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:35.679978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1209/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:35 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:36.266085 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.266564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.266694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.293648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:36.294774 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:36.301291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1216/2425] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:36.313522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:36.325331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee393e-2c2d-4234-9795-71c770e58099 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:36.329953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:36.330519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.330848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.331131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.339195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:36.364135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:36.372774 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1210/2426] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:49.807438 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:49.820256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f9e39-f0ed-4e7a-8b39-3fb0ca2e3021 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:49.825098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:49.825696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:49.825981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:49.826264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:49.827925 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:49.924017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:49.950247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2aa4b-0540-4de2-b443-4285b9181f00 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:49.971797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1217/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:49 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:50.653512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:50.654898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:50.666213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec5693-6dd4-4ba9-92fa-a411924bf6d0 service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:50.669485 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:50.670055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:50.670341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:50.670623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:50.672212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:50.681241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:50.706714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:50.715114 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1211/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:50 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:53.748046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81d20-334d-4594-90f3-0df54f63a8ae None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:53.748520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81d20-334d-4594-90f3-0df54f63a8ae None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:53.748615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec81d20-334d-4594-90f3-0df54f63a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:53.773108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-6ec81d20-334d-4594-90f3-0df54f63a8ae None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:53.774323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-6ec81d20-334d-4594-90f3-0df54f63a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:53.780892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1218/2429] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:53.792854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:53.804285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f1b17-13c4-4cff-bbee-a3280fe1adcf service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:53.808779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:53.809358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:53.809845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:53.810129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:53.818051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:53.844506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:53.853099 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1212/2430] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:58.818180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:58.819332 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:58.819623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:58.842923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:58.844334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:58.854055 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1219/2431] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:58.869815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:58.881543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6630b-7406-425b-96ab-11dec1ad0e1d service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:58.887148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:58.888125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:58.888649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:58.889044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:58.900041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:54:58.938892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:58.950848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1213/2432] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:05.559571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:05.561067 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:05.633455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf8e3-21ea-42a6-863e-0b329eaa6c53 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:05.637840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:05.638639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:05.638959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:05.639238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] PATH_INFO: `/v3/users/f5b08a414e0c45ab839107cccb69f179` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:05.640335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b08a414e0c45ab839107cccb69f179)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:05.666290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:05.713896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b08a414e0c45ab839107cccb69f179'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.720342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b08a414e0c45ab839107cccb69f179'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.720939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b08a414e0c45ab839107cccb69f179'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.721565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b08a414e0c45ab839107cccb69f179'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.729902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b08a414e0c45ab839107cccb69f179'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.750496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1220/2433] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:05 2022] DELETE /identity/v3/users/f5b08a414e0c45ab839107cccb69f179 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:06.044278 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.054758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d300980-221f-4499-a9e3-2ef3ac4bfae7 service swift] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.123227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.124055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.124351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.124662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] PATH_INFO: `/v3/projects/6eb5fe9c67d048c5b2097f9a923ac025` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.125778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb5fe9c67d048c5b2097f9a923ac025)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:06.152320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.200143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb5fe9c67d048c5b2097f9a923ac025', 'request_id': 'req-f089d1a7-b774-475a-9df4-805dbd4a3f69'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.206803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb5fe9c67d048c5b2097f9a923ac025', 'request_id': 'req-f089d1a7-b774-475a-9df4-805dbd4a3f69'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.218342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb5fe9c67d048c5b2097f9a923ac025', 'request_id': 'req-f089d1a7-b774-475a-9df4-805dbd4a3f69'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.228871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] The token cache is being invalidate because project 6eb5fe9c67d048c5b2097f9a923ac025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:06.229155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.229755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.231199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1214/2434] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:06 2022] DELETE /identity/v3/projects/6eb5fe9c67d048c5b2097f9a923ac025 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:06.235184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.236495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:06.248321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117781ed-9931-4b41-bf94-43f7bab2f4ee admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.310770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.311564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.311850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.312142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] PATH_INFO: `/v3/users/1650cb93329a4edf89f6cad7a5869931` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.313206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1650cb93329a4edf89f6cad7a5869931)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:06.338972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.387440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1650cb93329a4edf89f6cad7a5869931'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.394249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1650cb93329a4edf89f6cad7a5869931'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.394874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1650cb93329a4edf89f6cad7a5869931'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.395471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1650cb93329a4edf89f6cad7a5869931'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.403660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1650cb93329a4edf89f6cad7a5869931'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.421227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1221/2435] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:06 2022] DELETE /identity/v3/users/1650cb93329a4edf89f6cad7a5869931 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:06.641775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.643231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:06.655396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089d1a7-b774-475a-9df4-805dbd4a3f69 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.717015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.717805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.718097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.718377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] PATH_INFO: `/v3/projects/9abe65b75c49425d8eee644b8ac3a281` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.719496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abe65b75c49425d8eee644b8ac3a281)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:06.745376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.792958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abe65b75c49425d8eee644b8ac3a281', 'request_id': 'req-9a2e6b86-ebdd-4037-8c06-e684ef27a542'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.799547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abe65b75c49425d8eee644b8ac3a281', 'request_id': 'req-9a2e6b86-ebdd-4037-8c06-e684ef27a542'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.813003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abe65b75c49425d8eee644b8ac3a281', 'request_id': 'req-9a2e6b86-ebdd-4037-8c06-e684ef27a542'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.823393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] The token cache is being invalidate because project 9abe65b75c49425d8eee644b8ac3a281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:06.823663 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.824252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.825667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1215/2436] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:06 2022] DELETE /identity/v3/projects/9abe65b75c49425d8eee644b8ac3a281 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:33.478713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.480008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:33.566826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d715-b500-4eb5-a4bd-2e0e3830cc44 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.639691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.640292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.640584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.640871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.642573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:33.654535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:33.681249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.691748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1222/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:33 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:34.318237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:34.319781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.385432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e6b86-ebdd-4037-8c06-e684ef27a542 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:34.389025 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:34.389642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:34.389930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:34.390215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:34.391945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.459811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:34.485106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:34.495328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1216/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:40.091335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:40.092706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:40.103686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b2d45-fbaf-43b4-a4b8-3f832a4af7bd service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:40.107132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:40.107801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:40.108156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:40.108501 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:40.110372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:40.181449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:40.206536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:40.216526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1223/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:40.541998 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:40.550615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff8df8-8a88-44d2-b95f-a24d21d9996a service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:40.554171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:40.554855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:40.555209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:40.555558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:40.557265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:40.568487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:40.594006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:40.604655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1217/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:46.579051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:46.581151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:46.596817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccc148-2c13-4b6a-93b2-04e98ecfba58 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:46.602469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:46.603595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:46.603885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:46.604165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] PATH_INFO: `/v3/users/e2a88a8d7c9e4d0a88308c0e894570be` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:46.605277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a88a8d7c9e4d0a88308c0e894570be)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:46.636647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:46.690806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a88a8d7c9e4d0a88308c0e894570be'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.700086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a88a8d7c9e4d0a88308c0e894570be'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.700783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a88a8d7c9e4d0a88308c0e894570be'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.701467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a88a8d7c9e4d0a88308c0e894570be'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.711500 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bca4a3d6-cf81-4097-8df0-bdd284381ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a88a8d7c9e4d0a88308c0e894570be'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.734799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1224/2441] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:46 2022] DELETE /identity/v3/users/e2a88a8d7c9e4d0a88308c0e894570be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:47.200141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.217365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8107-94ad-4b94-92b9-dd589798bedd service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.290197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.291037 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.291395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.291771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] PATH_INFO: `/v3/projects/d7c31bb4f3ce486591bc142b1da7553e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.292953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c31bb4f3ce486591bc142b1da7553e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.320216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.378754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c31bb4f3ce486591bc142b1da7553e', 'request_id': 'req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.388704 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c31bb4f3ce486591bc142b1da7553e', 'request_id': 'req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.403497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c31bb4f3ce486591bc142b1da7553e', 'request_id': 'req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.415175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] The token cache is being invalidate because project d7c31bb4f3ce486591bc142b1da7553e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:47.415472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.416151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-1abe9107-ce57-41d7-a9fa-55e3ac44a80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.417862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1218/2442] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:47 2022] DELETE /identity/v3/projects/d7c31bb4f3ce486591bc142b1da7553e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:47.423856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.424260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.424899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.450318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:47.451502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.520539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1225/2443] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.528464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.528771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.529059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.550912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:47.552543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.559568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1219/2444] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.563930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.573488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa642d3a-e507-451a-9a8e-5113f2152d39 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.577578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.578158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.578444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.578744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.579435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:55:47.579986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.606140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.619269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1226/2445] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:55:47.623765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.633059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608b821-8b46-4e66-824a-2c04a2b031e1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.637303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.638100 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.638572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.638886 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.639526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.666642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.698365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1220/2446] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:47.702146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.715770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f1f2d-daa3-479e-954d-c3bf4261c615 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.782812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.783436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.783724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.784001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.784671 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.810269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.831034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1227/2447] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:47.835007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.847196 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705bf8-9be8-43bd-95cc-c3a189c1753c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.853081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.854541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.854965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.855352 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.856224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.883018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44222-240a-47aa-8347-82f543795279 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.893862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1221/2448] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:47.899276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.908826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a45bc-a4d4-4acd-aae7-aab0067cc935 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.913756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.914573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.914899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.915179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] PATH_INFO: `/v3/projects/c4fd8715dd9345e386bf4075456182e7/users/0822a4ab716d4d3483c01094975d65a4/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.936631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fd8715dd9345e386bf4075456182e7, user_id=0822a4ab716d4d3483c01094975d65a4, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:47.966171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.994488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1228/2449] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:47 2022] PUT /identity/v3/projects/c4fd8715dd9345e386bf4075456182e7/users/0822a4ab716d4d3483c01094975d65a4/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:47.995749 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.996047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.996329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.037058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] MFA Rules not processed for user `0822a4ab716d4d3483c01094975d65a4`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:48.038202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:48.111156 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1222/2450] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:48.115631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.185109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120b8ae-2fbe-4e0d-99d8-24742de7d743 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.189355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.189945 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.190237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.190520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.191227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.217182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.244280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1229/2451] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:48 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:48.248376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.258885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e7f8e-f642-4328-a58f-25e8d3d3345e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.322616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.323258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.323547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.323801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.324454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.350447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.370640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1223/2452] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:48 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:48.374445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.384742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a6001-c2f3-4614-81f2-90b5af5c8afc admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.389226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.389814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.390107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.390390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.391118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.416738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.428368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1230/2453] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:48.432494 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.442637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521585c-9297-489d-b91d-c0a30a4c7117 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.447017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.447841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.448134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.448417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] PATH_INFO: `/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.467948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5266c60c334ea0a6395fa1f24b4153, user_id=40c589dbd78941cabf9c07db186c0157, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.494596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.508716 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1224/2454] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:48 2022] PUT /identity/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:48.513011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.523369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3baac-83d0-489b-8b6b-28390b55ab7f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.587881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.588583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.588766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.589048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.589749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.616022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.626553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1231/2455] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:48.631604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.642127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdec1ad-7544-4485-b142-953640c9ec2f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.647302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.648118 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.648423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.648691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] PATH_INFO: `/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.650413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5266c60c334ea0a6395fa1f24b4153, user_id=40c589dbd78941cabf9c07db186c0157, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.677767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.690707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1225/2456] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:48 2022] PUT /identity/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:48.694608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.704506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b85dd5-4419-40a2-a173-478f370b19da admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.775883 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.776392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.776681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.776965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.777724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.803834 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc07731-4534-4b10-8141-fac7bca6b4b1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.814717 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1232/2457] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:48.819765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.829968 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6befec-99ed-4378-8eea-237582565678 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.835608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.836541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.836838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.837366 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] PATH_INFO: `/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.839237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5266c60c334ea0a6395fa1f24b4153, user_id=40c589dbd78941cabf9c07db186c0157, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:48.867154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.883543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1226/2458] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:48 2022] PUT /identity/v3/projects/2b5266c60c334ea0a6395fa1f24b4153/users/40c589dbd78941cabf9c07db186c0157/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:48.893806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.894292 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.894782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.936726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] MFA Rules not processed for user `40c589dbd78941cabf9c07db186c0157`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:48.938322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:49.028911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1233/2459] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:48 2022] POST /identity/v3/auth/tokens => generated 3765 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:49.038859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:49.040648 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:49.108418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8daa93-56ae-47d6-8985-99d1290e0048 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:49.111918 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:49.112504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:49.112795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:49.113077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:49.122420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:49.148884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:49.158591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1227/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:49 2022] GET /identity/v3/auth/tokens => generated 3765 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:49.204758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:49.206113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:49.218971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab686375-e0e8-4e4e-acbf-5c501f19b5f3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:49.222312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:49.222930 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:49.223866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:49.224177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:49.292048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:49.318637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:49.327962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1234/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:49 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:52.807502 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:52.809272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:52.883242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4601c97-2275-4c8f-9525-e03d2f5ca8ac service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:52.887857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:52.888657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:52.888944 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:52.889224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] PATH_INFO: `/v3/users/a86a950d41cc44fb9f10b600b20b0ae6` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:52.890302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86a950d41cc44fb9f10b600b20b0ae6)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:52.917975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:52.977044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86a950d41cc44fb9f10b600b20b0ae6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.990701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86a950d41cc44fb9f10b600b20b0ae6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.991363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86a950d41cc44fb9f10b600b20b0ae6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.991959 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86a950d41cc44fb9f10b600b20b0ae6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.999617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86a950d41cc44fb9f10b600b20b0ae6'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.014873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1228/2462] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:52 2022] DELETE /identity/v3/users/a86a950d41cc44fb9f10b600b20b0ae6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.154312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.165251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bc8c4-b4eb-47a2-b769-178d566b32e2 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.232050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.233372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.233703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.234009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] PATH_INFO: `/v3/users/0822a4ab716d4d3483c01094975d65a4` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.235330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0822a4ab716d4d3483c01094975d65a4)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:53.250855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.252307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:53.265771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5339f2-1ca8-4fef-b413-f2139a1fd1e6 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.267844 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.271657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.272451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.272744 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.273155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] PATH_INFO: `/v3/projects/89f311117084470f8e8d16c47ad1d2ae` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.274409 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f311117084470f8e8d16c47ad1d2ae)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:53.302222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.318657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0822a4ab716d4d3483c01094975d65a4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.326691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0822a4ab716d4d3483c01094975d65a4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.328168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0822a4ab716d4d3483c01094975d65a4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.328870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0822a4ab716d4d3483c01094975d65a4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.338370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c83f7171-4a67-40aa-896e-22b4dd6489e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0822a4ab716d4d3483c01094975d65a4'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.356194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1235/2463] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/users/0822a4ab716d4d3483c01094975d65a4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.360643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.360941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f311117084470f8e8d16c47ad1d2ae', 'request_id': 'req-3fd471ec-aad4-40db-95f2-3ba9ab25093a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.361135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.361424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.369986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f311117084470f8e8d16c47ad1d2ae', 'request_id': 'req-3fd471ec-aad4-40db-95f2-3ba9ab25093a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.382351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f311117084470f8e8d16c47ad1d2ae', 'request_id': 'req-3fd471ec-aad4-40db-95f2-3ba9ab25093a'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.384636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:53.385808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:53.392854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] The token cache is being invalidate because project 89f311117084470f8e8d16c47ad1d2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:53.393410 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.394219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.396910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1229/2464] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/projects/89f311117084470f8e8d16c47ad1d2ae => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.400735 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.402188 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:53.461779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1236/2465] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:53.472317 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.474613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:53.479778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd471ec-aad4-40db-95f2-3ba9ab25093a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.484233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.485042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.485334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.485622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] PATH_INFO: `/v3/users/1e3d36f842884e828bc17c50b319fcd2` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.486767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3d36f842884e828bc17c50b319fcd2)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:53.512727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.538656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2029-39a4-4fbb-80e3-e615565b8721 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.542373 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.542989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.543280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.543601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.553061 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:53.561857 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3d36f842884e828bc17c50b319fcd2'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.576211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3d36f842884e828bc17c50b319fcd2'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.577039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3d36f842884e828bc17c50b319fcd2'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.577732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3d36f842884e828bc17c50b319fcd2'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.578657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.586355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3d36f842884e828bc17c50b319fcd2'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.590809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1237/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:53.602811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1230/2467] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/users/1e3d36f842884e828bc17c50b319fcd2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.837203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.847090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0393a-5b68-41ce-8b74-54c8c1ca5c7f service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.918868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.919772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.920065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.920345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] PATH_INFO: `/v3/projects/2693886eb62643358125af592825867f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.921449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2693886eb62643358125af592825867f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:53.949216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.014151 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2693886eb62643358125af592825867f', 'request_id': 'req-a28c7523-21a9-4479-9658-6491c840998d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.021440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2693886eb62643358125af592825867f', 'request_id': 'req-a28c7523-21a9-4479-9658-6491c840998d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.034474 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2693886eb62643358125af592825867f', 'request_id': 'req-a28c7523-21a9-4479-9658-6491c840998d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.051980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] The token cache is being invalidate because project 2693886eb62643358125af592825867f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:54.052751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.053423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.055714 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1238/2468] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/projects/2693886eb62643358125af592825867f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:54.116311 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.118406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.152084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b27d39-7c17-48d1-8bec-18c869fbcf39 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.222255 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.223218 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.223557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.223846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] PATH_INFO: `/v3/projects/c4fd8715dd9345e386bf4075456182e7` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.225036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fd8715dd9345e386bf4075456182e7)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:54.252146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.310362 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fd8715dd9345e386bf4075456182e7', 'request_id': 'req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.320842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fd8715dd9345e386bf4075456182e7', 'request_id': 'req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.337597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fd8715dd9345e386bf4075456182e7', 'request_id': 'req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.348204 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] The token cache is being invalidate because project c4fd8715dd9345e386bf4075456182e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:54.348527 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.349210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.350957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1231/2469] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:54 2022] DELETE /identity/v3/projects/c4fd8715dd9345e386bf4075456182e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:54.354521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.356466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.368627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7523-21a9-4479-9658-6491c840998d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.432378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.433112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.433403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.433684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] PATH_INFO: `/v3/users/40c589dbd78941cabf9c07db186c0157` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.434821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c589dbd78941cabf9c07db186c0157)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:54.460804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.509777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c589dbd78941cabf9c07db186c0157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.516502 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c589dbd78941cabf9c07db186c0157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.517139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c589dbd78941cabf9c07db186c0157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.517784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c589dbd78941cabf9c07db186c0157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.525588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8b4db5ec-1ba1-4259-827b-25b615878c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c589dbd78941cabf9c07db186c0157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.542811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1239/2470] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:54 2022] DELETE /identity/v3/users/40c589dbd78941cabf9c07db186c0157 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:54.889386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.890822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.903659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705c6c4-cbf3-4a98-8ac3-2ef9ce7ef1ad admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.965264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.966105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.966396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.966727 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] PATH_INFO: `/v3/projects/2b5266c60c334ea0a6395fa1f24b4153` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.967821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5266c60c334ea0a6395fa1f24b4153)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:54.994329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.048361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5266c60c334ea0a6395fa1f24b4153', 'request_id': 'req-ef8f3100-9369-4c2a-81a3-9c68306248b9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:55.055305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5266c60c334ea0a6395fa1f24b4153', 'request_id': 'req-ef8f3100-9369-4c2a-81a3-9c68306248b9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:55.069061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5266c60c334ea0a6395fa1f24b4153', 'request_id': 'req-ef8f3100-9369-4c2a-81a3-9c68306248b9'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:55.078634 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] The token cache is being invalidate because project 2b5266c60c334ea0a6395fa1f24b4153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:55.078939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:55.079562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ef8f3100-9369-4c2a-81a3-9c68306248b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:55.080934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1232/2471] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:54 2022] DELETE /identity/v3/projects/2b5266c60c334ea0a6395fa1f24b4153 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:55.086395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b995-a534-4410-9887-add214c10089 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.086703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b995-a534-4410-9887-add214c10089 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.086993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5b995-a534-4410-9887-add214c10089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.109402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8fe5b995-a534-4410-9887-add214c10089 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:55.110561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8fe5b995-a534-4410-9887-add214c10089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:55.177079 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1240/2472] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:55.185920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.186405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.186535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.209553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:55.210728 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:55.217645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1233/2473] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:55.221657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b995-a534-4410-9887-add214c10089 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.231021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5b995-a534-4410-9887-add214c10089 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.235109 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.235689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.235976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.236261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.236948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:55:55.237244 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.263236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.276410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1241/2474] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:55.280724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.289335 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e9172-84a0-48c3-bffc-857a38bdf686 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.293592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.294171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.294459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.294775 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.295413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.320995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.347736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1234/2475] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:55.351748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.361027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3c1d2-6b6d-443e-bc60-ef5515cf1a9a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.423855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.424452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.424743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.425027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.425668 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.452430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.472018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1242/2476] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:55.476280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.485887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31729257-1a1e-44a1-b6ed-5a86571439e0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.491096 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.491689 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.491982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.492267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.492963 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.520612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e33f5-d6f7-4c64-9703-b1bd6d9a41d3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.530780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1235/2477] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:55.534973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.545094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c644b3e-0a48-4c50-92af-ab4f99e05dce admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.549544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.550349 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.550636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.551428 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] PATH_INFO: `/v3/projects/7977bd8be3e5400db3a28dd363e39334/users/1c9bd73bb14b49b88f2c90a932d99367/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.571536 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7977bd8be3e5400db3a28dd363e39334, user_id=1c9bd73bb14b49b88f2c90a932d99367, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.600936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.615364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1243/2478] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:55 2022] PUT /identity/v3/projects/7977bd8be3e5400db3a28dd363e39334/users/1c9bd73bb14b49b88f2c90a932d99367/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:55.625603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.625929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.626249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.664920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] MFA Rules not processed for user `1c9bd73bb14b49b88f2c90a932d99367`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:55.666090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:55.746030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1236/2479] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:55.750937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.826728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d998f-a959-4bd7-b261-f2049aca8393 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.831143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.831729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.832043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.832863 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.833507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:55.861627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.888953 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1244/2480] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:55.892939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.908344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031510-d12d-4e07-94ec-09244fa61b43 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.974999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.975604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.975898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.976180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.976862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.008245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.033615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1237/2481] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:56.037812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.048202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351366ba-e3c4-42ff-b948-c72280b0c54b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.053281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.053990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.054350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.054751 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.055443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.082105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e72a11-31fb-4a62-9642-f84fcdb3be36 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.098049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1245/2482] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:56.099373 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.108962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb8fd-1a75-4006-927e-8f5b182afc8c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.113152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.114060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.114458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.114782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] PATH_INFO: `/v3/projects/fade77a45c564e88a78cc28c9d36b243/users/56b3b52dee2743a1bcca7f63b88792c1/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.135265 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fade77a45c564e88a78cc28c9d36b243, user_id=56b3b52dee2743a1bcca7f63b88792c1, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.162672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.175639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1238/2483] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:56 2022] PUT /identity/v3/projects/fade77a45c564e88a78cc28c9d36b243/users/56b3b52dee2743a1bcca7f63b88792c1/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:56.186586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.187023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.187379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.223580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] MFA Rules not processed for user `56b3b52dee2743a1bcca7f63b88792c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:56.224817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:56.296637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1246/2484] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:56 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:56.301757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.369487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633496c8-5644-463e-b230-9f41508b3395 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.373785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.374376 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.374688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.374981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.375627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.402324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.433040 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1239/2485] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:56.434595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.446272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cdb0f-38a4-4be5-8066-d295162841de None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.509656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.510265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.510555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.510870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.511521 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.537870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.559522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1247/2486] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:56 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:56.563612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.574369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7932-7207-41a2-96f4-eccd797de5ae admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.578688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.579332 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.579722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.580075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.580838 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.610905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.625249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1240/2487] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:56.629639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.639697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d899c-84aa-4137-8e78-50181b57fe2c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.644111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.644933 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.645225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.645508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] PATH_INFO: `/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.665645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb69b1794c804da6b6a1f1d2fe8286ed, user_id=80f16613858d4721bb1cbd47b33e7d01, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.692582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.705358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1248/2488] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:56 2022] PUT /identity/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:56.709651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.719368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95bd0-e2bb-4265-8011-3dfdbe025629 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.784232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.784953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.785326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.785691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.786463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.811460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.822438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1241/2489] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:56.826685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.837279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714cc1-8a54-4694-92aa-2cb2cc18a0bd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.842441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.843314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.843599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.844043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] PATH_INFO: `/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.845665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb69b1794c804da6b6a1f1d2fe8286ed, user_id=80f16613858d4721bb1cbd47b33e7d01, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:56.872290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:56.883886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1249/2490] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:56 2022] PUT /identity/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:56.887915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:56.898371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f12b-f0bc-4e6c-9330-d770975aca78 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:56.981209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:56.982081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:56.982535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:56.983081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:56.983814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:57.013371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad5296-00f7-45b4-a918-487dd245a66b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:57.025481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1242/2491] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:57.029421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:57.039696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5de7-1090-42c7-bf5b-29603d95127f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:57.044211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:57.045039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:57.045340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:57.045614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] PATH_INFO: `/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:57.047413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb69b1794c804da6b6a1f1d2fe8286ed, user_id=80f16613858d4721bb1cbd47b33e7d01, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:57.075596 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:57.091965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1250/2492] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:57 2022] PUT /identity/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed/users/80f16613858d4721bb1cbd47b33e7d01/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:57.102330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:57.102629 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:57.102945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:57.140238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] MFA Rules not processed for user `80f16613858d4721bb1cbd47b33e7d01`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:57.141461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:57.216363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1243/2493] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:57.226645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:57.228299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:57.303240 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d471c-3b61-4c7f-a2d9-27fe8c4b6cc9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:57.306676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:57.307309 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:57.307603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:57.307885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:57.318402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:57.344972 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:57.357636 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1251/2494] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:57 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:57.419896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:57.421257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:57.436826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68693f4c-1499-418e-ae6b-376e6b9f0802 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:57.440937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:57.440937 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:57.441211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:57.441380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:57.517571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:55:57.545106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a67fc-805e-4134-ae6f-16b11651c456 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:57.555883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1244/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:57 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:00.790331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.858013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8824ddf-bc4e-4944-a3f8-cf395a2fc181 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.862519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.863335 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.863621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.863897 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] PATH_INFO: `/v3/users/1c9bd73bb14b49b88f2c90a932d99367` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.865478 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9bd73bb14b49b88f2c90a932d99367)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:00.891484 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.937782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9bd73bb14b49b88f2c90a932d99367'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.944910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9bd73bb14b49b88f2c90a932d99367'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.945646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9bd73bb14b49b88f2c90a932d99367'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.946271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9bd73bb14b49b88f2c90a932d99367'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.954088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9bd73bb14b49b88f2c90a932d99367'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.970766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1252/2496] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:00 2022] DELETE /identity/v3/users/1c9bd73bb14b49b88f2c90a932d99367 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:00.975279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.975754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.975905 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.998393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:00.999578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.065676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1245/2497] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:01.076898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:01.078239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.141788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31135b-1822-4c05-8083-66c9ecc7548a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:01.145150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:01.145767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:01.146112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:01.146396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:01.155062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:01.181024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:01.190040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1253/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:01.540419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:01.541850 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.557251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c025-a382-42c5-93fb-e577f4ef5f71 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:01.561518 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:01.562325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:01.562584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:01.562898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] PATH_INFO: `/v3/projects/7977bd8be3e5400db3a28dd363e39334` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:01.564017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7977bd8be3e5400db3a28dd363e39334)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:01.589752 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:01.641039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7977bd8be3e5400db3a28dd363e39334', 'request_id': 'req-12a68b96-8957-41f4-9717-ab93e67126cc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.649591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7977bd8be3e5400db3a28dd363e39334', 'request_id': 'req-12a68b96-8957-41f4-9717-ab93e67126cc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.660547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7977bd8be3e5400db3a28dd363e39334', 'request_id': 'req-12a68b96-8957-41f4-9717-ab93e67126cc'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.670085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] The token cache is being invalidate because project 7977bd8be3e5400db3a28dd363e39334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:01.670364 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.670977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.672380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1246/2499] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:01 2022] DELETE /identity/v3/projects/7977bd8be3e5400db3a28dd363e39334 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:01.676276 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:01.686466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86458d29-9baf-4360-b57b-2f4d8be0bb95 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:01.753273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:01.754128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:01.754441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:01.754801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] PATH_INFO: `/v3/users/56b3b52dee2743a1bcca7f63b88792c1` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:01.756366 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b3b52dee2743a1bcca7f63b88792c1)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:01.782026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:01.828575 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b3b52dee2743a1bcca7f63b88792c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.835261 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b3b52dee2743a1bcca7f63b88792c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.835874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b3b52dee2743a1bcca7f63b88792c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.836490 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b3b52dee2743a1bcca7f63b88792c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.844063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b3b52dee2743a1bcca7f63b88792c1'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:01.861302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1254/2500] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:01 2022] DELETE /identity/v3/users/56b3b52dee2743a1bcca7f63b88792c1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:02.214615 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.216031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:02.228017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68b96-8957-41f4-9717-ab93e67126cc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.289830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.290551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.290869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.291155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] PATH_INFO: `/v3/projects/fade77a45c564e88a78cc28c9d36b243` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.292234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fade77a45c564e88a78cc28c9d36b243)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:02.320404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.368402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fade77a45c564e88a78cc28c9d36b243', 'request_id': 'req-b7be0c1d-3502-43f3-8044-e876aaf32e9e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.375182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fade77a45c564e88a78cc28c9d36b243', 'request_id': 'req-b7be0c1d-3502-43f3-8044-e876aaf32e9e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.386989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fade77a45c564e88a78cc28c9d36b243', 'request_id': 'req-b7be0c1d-3502-43f3-8044-e876aaf32e9e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.397022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] The token cache is being invalidate because project fade77a45c564e88a78cc28c9d36b243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:02.397302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.397915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.399343 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1247/2501] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:02 2022] DELETE /identity/v3/projects/fade77a45c564e88a78cc28c9d36b243 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:02.403388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.404705 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:02.417362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3746348-cae4-491f-ad07-183892d20487 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.483881 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.484677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.484993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.485277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] PATH_INFO: `/v3/users/80f16613858d4721bb1cbd47b33e7d01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.486382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f16613858d4721bb1cbd47b33e7d01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:02.512810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.561437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f16613858d4721bb1cbd47b33e7d01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.567791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f16613858d4721bb1cbd47b33e7d01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.568364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f16613858d4721bb1cbd47b33e7d01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.568939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f16613858d4721bb1cbd47b33e7d01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.576439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-943992ef-59f6-47e9-8d05-ef87288b3e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f16613858d4721bb1cbd47b33e7d01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:02.593409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1255/2502] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:02 2022] DELETE /identity/v3/users/80f16613858d4721bb1cbd47b33e7d01 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:02.939022 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.940350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:02.953861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be0c1d-3502-43f3-8044-e876aaf32e9e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.018050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.018887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.019154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.019552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] PATH_INFO: `/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.021419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb69b1794c804da6b6a1f1d2fe8286ed)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.047670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.099652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb69b1794c804da6b6a1f1d2fe8286ed', 'request_id': 'req-a9f188d1-da04-425a-ac59-a4998d5acb51'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:03.106641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb69b1794c804da6b6a1f1d2fe8286ed', 'request_id': 'req-a9f188d1-da04-425a-ac59-a4998d5acb51'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:03.118641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb69b1794c804da6b6a1f1d2fe8286ed', 'request_id': 'req-a9f188d1-da04-425a-ac59-a4998d5acb51'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:03.128324 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] The token cache is being invalidate because project fb69b1794c804da6b6a1f1d2fe8286ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:03.128605 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:03.129215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-a9f188d1-da04-425a-ac59-a4998d5acb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:03.131480 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1248/2503] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:02 2022] DELETE /identity/v3/projects/fb69b1794c804da6b6a1f1d2fe8286ed => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:03.139087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.139556 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.139654 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.162070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:03.163251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.229004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1256/2504] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:03.237299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.237780 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.237911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.264931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:03.266222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.273683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1249/2505] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:03.278250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.288098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc3622-d0eb-4293-b00a-63b624e6100d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.292376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.292970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.293260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.293540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.294271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:03.294574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.321441 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.335752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1257/2506] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:03.340008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.349493 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584a15e-c44a-4861-8131-eae85a9f2a95 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.353572 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.354152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.354438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.354746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.355382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.381011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.407437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1250/2507] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:03.412344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.421744 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a883bf6-47a3-43b9-88f5-13ae6e512954 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.483840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.484444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.484723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.485001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.485627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.511603 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.531092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1258/2508] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:03.535194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.545724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b833c-b920-4875-9eb1-d21b298ea1bf admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.550083 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.550773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.551067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.551351 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.552678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.577486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ecbe8-e3b3-461f-980e-5c33b3dc5ec2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.587641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1251/2509] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:03.591854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.602152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4816-ea79-4abe-ac3a-1f6ef7eef128 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.606461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.607330 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.607638 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.607920 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] PATH_INFO: `/v3/projects/8aaf8d4e4b044237975a13ee3181d247/users/dd58e9e89e084629a36dfa56bfcd32e8/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.627962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaf8d4e4b044237975a13ee3181d247, user_id=dd58e9e89e084629a36dfa56bfcd32e8, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.654677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.667650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1259/2510] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:03 2022] PUT /identity/v3/projects/8aaf8d4e4b044237975a13ee3181d247/users/dd58e9e89e084629a36dfa56bfcd32e8/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:03.681044 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.681395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.681687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.723101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] MFA Rules not processed for user `dd58e9e89e084629a36dfa56bfcd32e8`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:03.725286 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.797656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1252/2511] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:03.808048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.809685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.874586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6854b-b116-4ccd-8b34-bab4a358ead2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.877820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.878392 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.878703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.878989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.887117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:03.915554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:03.924227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1260/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:03 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:04.549500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:04.550869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:04.612887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33bf65-57d2-4784-9a77-00ea0c0cb8bf None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:04.616759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:04.617328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:04.617616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:04.617893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:04.619640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:04.686556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:04.712051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe09c2-852d-4eac-9582-a7da6967157e service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:04.721170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1253/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:06.700278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:06.711344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ef72-fb09-4227-822a-521ae4d334c2 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:06.715447 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:06.716232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:06.716519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:06.716828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] PATH_INFO: `/v3/users/dd58e9e89e084629a36dfa56bfcd32e8` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:06.717911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd58e9e89e084629a36dfa56bfcd32e8)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:06.744498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:06.795935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd58e9e89e084629a36dfa56bfcd32e8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:06.803577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd58e9e89e084629a36dfa56bfcd32e8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:06.804209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd58e9e89e084629a36dfa56bfcd32e8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:06.804783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd58e9e89e084629a36dfa56bfcd32e8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:06.812692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd58e9e89e084629a36dfa56bfcd32e8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:06.830035 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1261/2514] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:06 2022] DELETE /identity/v3/users/dd58e9e89e084629a36dfa56bfcd32e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:06.834616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:06.835151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:06.835252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:06.857669 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:06.858859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:06.925426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1254/2515] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:06.936726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:06.938365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:07.008027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013a3a-8cc2-43e4-87bb-9c8715c4becd admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:07.011967 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:07.013162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.013449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.013799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.024125 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:07.050230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb2578-7ed0-479e-ac99-900f8bf2e7aa service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:07.060531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1262/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:07.430348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:07.432888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:07.451559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187792-872e-4680-8b43-f5e0c3d8d22a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:07.454141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:07.455439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.455826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.456108 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] PATH_INFO: `/v3/projects/8aaf8d4e4b044237975a13ee3181d247` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.457425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aaf8d4e4b044237975a13ee3181d247)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:07.486989 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:07.548497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aaf8d4e4b044237975a13ee3181d247', 'request_id': 'req-69c4d19a-fd37-409e-b053-447f3e0b935e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:07.559685 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aaf8d4e4b044237975a13ee3181d247', 'request_id': 'req-69c4d19a-fd37-409e-b053-447f3e0b935e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:07.576092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aaf8d4e4b044237975a13ee3181d247', 'request_id': 'req-69c4d19a-fd37-409e-b053-447f3e0b935e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:07.591006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] The token cache is being invalidate because project 8aaf8d4e4b044237975a13ee3181d247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:07.591758 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:07.594445 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-69c4d19a-fd37-409e-b053-447f3e0b935e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:07.598756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1255/2517] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:07 2022] DELETE /identity/v3/projects/8aaf8d4e4b044237975a13ee3181d247 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:07.602794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.603162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.604099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.636082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:07.638059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:07.736118 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1263/2518] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:07.745499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.746272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.748207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.773565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:07.776116 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:07.784345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1256/2519] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:07.789218 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:07.799541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7e10c-1463-4c5c-8733-affc0c4b688d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:07.807034 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:07.807647 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.807943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.808227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.809114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:07.809417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:07.840156 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:07.854829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1264/2520] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:07.859405 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:07.869858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5dc0-dd21-4589-9185-26b878d23c6e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:07.874355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:07.875010 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:07.875304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:07.875586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:07.876395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:07.903348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:07.941805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1257/2521] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:07 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:07.944558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:07.957679 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025c41e-2813-4a4b-a4ff-0f4185143cd5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:08.084405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:08.085364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:08.085666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:08.085951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:08.086625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:08.113684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:08.139073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1265/2522] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:07 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:08.142932 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:08.153382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23fa3-6edd-499e-9502-247e2e907b25 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:08.157828 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:08.158419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:08.158731 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:08.159013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:08.159706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:08.186954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45050a4-f536-48fd-829b-ca62f75f13a3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:08.198941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1258/2523] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:08.202720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:08.219023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2f8ab-f552-4d0b-96e7-9542df0c8006 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:08.222383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:08.223802 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:08.224523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:08.224523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] PATH_INFO: `/v3/projects/c89cf122bfb64dbca81527f5cac790a5/users/6d94e2a615ab42aaa79b7c8470f7808a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:08.245876 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89cf122bfb64dbca81527f5cac790a5, user_id=6d94e2a615ab42aaa79b7c8470f7808a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:08.279013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:08.293634 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1266/2524] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:08 2022] PUT /identity/v3/projects/c89cf122bfb64dbca81527f5cac790a5/users/6d94e2a615ab42aaa79b7c8470f7808a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:08.299591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:08.300206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:08.300706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:08.327348 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:08.331148 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:08.398431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1259/2525] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:08.413042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:08.413991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:08.478815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9bbb-f774-49f0-9fa2-23bce503d385 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:08.482345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:08.482966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:08.483255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:08.483541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:08.493098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:08.519900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:08.529396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1267/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:10.788007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:10.790082 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:10.803219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965428e5-93e9-4bf1-a960-34d97aa9036c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:10.807692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:10.808498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:10.808789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:10.809072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] PATH_INFO: `/v3/users/b68bc45984974d6da1c9151c21dae14c` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:10.830060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68bc45984974d6da1c9151c21dae14c)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:10.857429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:10.944901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68bc45984974d6da1c9151c21dae14c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:10.959538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68bc45984974d6da1c9151c21dae14c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:10.960646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68bc45984974d6da1c9151c21dae14c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:10.961590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68bc45984974d6da1c9151c21dae14c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:10.972440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7ce33f50-58cb-47ed-9bff-052083112554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68bc45984974d6da1c9151c21dae14c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.003107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1260/2527] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:10 2022] DELETE /identity/v3/users/b68bc45984974d6da1c9151c21dae14c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:11.742743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:11.752201 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82eba1-1881-492d-86cd-438aabcd0956 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:11.821380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:11.822174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:11.822461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:11.822775 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] PATH_INFO: `/v3/projects/cbbf5bb7e51d4d2d8594d6d1d3a797a3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:11.834672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbf5bb7e51d4d2d8594d6d1d3a797a3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:11.861217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:11.920133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'request_id': 'req-756d2e83-0a1a-4400-ad9a-4de6ef11885e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.925602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'request_id': 'req-756d2e83-0a1a-4400-ad9a-4de6ef11885e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.939081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'request_id': 'req-756d2e83-0a1a-4400-ad9a-4de6ef11885e'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.957748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] The token cache is being invalidate because project cbbf5bb7e51d4d2d8594d6d1d3a797a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:11.958137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.958983 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-756d2e83-0a1a-4400-ad9a-4de6ef11885e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:11.964485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1268/2528] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:11 2022] DELETE /identity/v3/projects/cbbf5bb7e51d4d2d8594d6d1d3a797a3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:11.966041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:11.966547 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:11.966645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.033975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:12.037436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:12.274182 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1261/2529] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:12.281568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:12.282083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:12.282582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.313250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:12.315050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:12.346450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1269/2530] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:12.351086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:12.362337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49579db1-1649-4dfa-83a6-77a8683a6c6e None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:12.374923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:12.375692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:12.375985 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:12.376273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.376971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:12.377270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:12.431404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:12.460436 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1262/2531] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:12.464730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:12.477817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adedc3-b5f3-44a3-81f5-7138f08c142d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:12.490687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:12.499318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:12.500327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:12.500715 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.501504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:12.579194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:12.653740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1270/2532] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:12 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:12.654635 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:12.673059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1bcb-a458-4f23-b473-5ecf490e4176 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:12.838540 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:12.839291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:12.839451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:12.839904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.840714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:12.883217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:12.911233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1263/2533] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:12 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:12.915740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:12.928377 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368d7ba-0e5a-428d-87b0-5ae6b3a75a95 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:12.933485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:12.934273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:12.934758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:12.935225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:12.936099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:12.966471 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674dfb-0fb3-4524-a428-9e36efcfbca9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:12.981597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1271/2534] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:12.985841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:12.998281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e214e7-0d0a-4770-bf6e-c9993790253d admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:13.003700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:13.005388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:13.006033 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:13.006479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] PATH_INFO: `/v3/projects/50993a23344b434db897122be3cd54f2/users/459115f143e84694bb7bb5dadddf8e5a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:13.030655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50993a23344b434db897122be3cd54f2, user_id=459115f143e84694bb7bb5dadddf8e5a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:13.059652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:13.079607 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1264/2535] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:12 2022] PUT /identity/v3/projects/50993a23344b434db897122be3cd54f2/users/459115f143e84694bb7bb5dadddf8e5a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:13.090503 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da50c8-f127-472b-a194-b1ede642dc18 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:13.090841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da50c8-f127-472b-a194-b1ede642dc18 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:13.091168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da50c8-f127-472b-a194-b1ede642dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:13.140031 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c1da50c8-f127-472b-a194-b1ede642dc18 None None] MFA Rules not processed for user `459115f143e84694bb7bb5dadddf8e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:13.141220 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c1da50c8-f127-472b-a194-b1ede642dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:13.238936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1272/2536] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:13 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:13.247975 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:13.250274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:13.336785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885ec0d-a8d5-4161-a124-25e0b9110c56 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:13.342159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:13.343109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:13.343564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:13.344009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:13.355632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:13.391193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:13.403173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1265/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:13 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:16.276040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.276613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.276734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.320364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] MFA Rules not processed for user `6d94e2a615ab42aaa79b7c8470f7808a`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:16.321937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:16.411333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1273/2538] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:16 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:16.416820 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.418382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:16.506497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ddd8-8231-4c0f-a6f8-8d4f47e14a69 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:16.512845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:16.513738 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.514293 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.514805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.515532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:16.545162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:16.575230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1266/2539] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:16.579417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.591569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6edaf-34f4-4bff-b4b4-dfe05c56185d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:16.657657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:16.658273 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.658562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.658875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.659515 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:16.686728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:16.707879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1274/2540] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:16 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:16.712005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.721973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9ca-9e03-4cfb-b4a4-8445f58d2a11 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:16.726382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:16.727232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.727706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.728051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.728825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:16.754922 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:16.767434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1267/2541] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:16.772496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.782722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46da6b-1bda-48fe-867f-ae4d16b6f900 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:16.787790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:16.788625 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.788918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.789206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] PATH_INFO: `/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.810157 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152098382d404cbdb5261f1d56a88f6c, user_id=c6c6f1d3614a4886a934f083eb214349, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:16.836620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:16.850771 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1275/2542] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:16 2022] PUT /identity/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:16.854787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.864768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0ca-2dec-4aea-a6d6-29e0cb0c099f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:16.935656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:16.936545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:16.936545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:16.936805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:16.937528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:16.965524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:16.977195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1268/2543] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:16.981089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:16.993301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8256b-24b3-4f98-9975-5a152e364d28 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:17.006790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:17.007875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:17.008165 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:17.008451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] PATH_INFO: `/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:17.010263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=152098382d404cbdb5261f1d56a88f6c, user_id=c6c6f1d3614a4886a934f083eb214349, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:17.038290 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:17.051816 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1276/2544] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:16 2022] PUT /identity/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:17.055813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:17.065463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ee6f-1104-4fdb-95e2-aa6e17f9e9f0 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:17.130992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:17.131590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:17.131880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:17.132165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:17.132863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:17.158829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:17.169355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1269/2545] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:17.173570 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:17.183383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58507-61ad-4aeb-99e1-b9ea68b82cdf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:17.187731 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:17.188537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:17.188828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:17.189105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] PATH_INFO: `/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:17.190915 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152098382d404cbdb5261f1d56a88f6c, user_id=c6c6f1d3614a4886a934f083eb214349, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:17.219990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8546fc-3eff-4b1e-ab71-5db48c027ca5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:17.234904 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1277/2546] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:17 2022] PUT /identity/v3/projects/152098382d404cbdb5261f1d56a88f6c/users/c6c6f1d3614a4886a934f083eb214349/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:18.987053 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:18.989832 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:19.113327 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe930092-0009-4c76-a698-be990bd98a07 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:19.186223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:19.187093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:19.187495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:19.187884 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:19.191209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:19.296897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:19.330212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:19.343319 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1270/2547] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:23.252993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.253582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.253582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.303008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] MFA Rules not processed for user `c6c6f1d3614a4886a934f083eb214349`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:23.304194 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:23.398026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1278/2548] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:23.414299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:23.416181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:23.524367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f116eea-a860-4006-bc51-547e34a60768 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:23.529732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:23.530396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.530816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.531170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.599844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:23.625911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9df24b-eee6-422f-a356-a3df820d98d2 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:23.640313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1271/2549] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:23 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:23.886648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:23.897206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586480-9569-4bc1-a716-58193d34f7b5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:23.901530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:23.902410 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.902798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.903473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] PATH_INFO: `/v3/users/459115f143e84694bb7bb5dadddf8e5a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.904232 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=459115f143e84694bb7bb5dadddf8e5a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:23.931573 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.028318 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459115f143e84694bb7bb5dadddf8e5a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:24.045534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459115f143e84694bb7bb5dadddf8e5a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:24.045534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459115f143e84694bb7bb5dadddf8e5a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:24.046185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459115f143e84694bb7bb5dadddf8e5a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:24.064262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459115f143e84694bb7bb5dadddf8e5a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:24.092827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1279/2550] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:23 2022] DELETE /identity/v3/users/459115f143e84694bb7bb5dadddf8e5a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:24.097403 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.097754 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.098520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.132223 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:24.133435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.210842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1272/2551] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:24.227685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.229916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.308951 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050bda8-c4b3-4c36-a26c-09d4a251c0af admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.313062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.314042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.314160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.314463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.327224 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:24.359012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d6125-31c4-4d53-9b44-99d8d1813ffd service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.388088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1280/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:24.970512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.973804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.989147 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae421f5-e65c-4b6b-94c2-88d980600b0a None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.994229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.995558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.996397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.996864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] PATH_INFO: `/v3/projects/50993a23344b434db897122be3cd54f2` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.998364 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=50993a23344b434db897122be3cd54f2)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.029678 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.095092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50993a23344b434db897122be3cd54f2', 'request_id': 'req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:25.104020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50993a23344b434db897122be3cd54f2', 'request_id': 'req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:25.116338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50993a23344b434db897122be3cd54f2', 'request_id': 'req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:25.128047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] The token cache is being invalidate because project 50993a23344b434db897122be3cd54f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:25.128437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:25.129620 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4e28daba-aaa3-4e86-9e67-3bdbd150e6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:25.131580 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1273/2553] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:24 2022] DELETE /identity/v3/projects/50993a23344b434db897122be3cd54f2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:25.136723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.137146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.138017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.167939 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:25.169237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:25.254444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1281/2554] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:25.257088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.257385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.257670 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.282536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:25.284201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:25.294350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1274/2555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:25.297954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.310887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20067dae-919c-4c04-9f79-f5896e23de8c None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.316557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.317483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.318046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.318426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.319990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:25.320396 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.360752 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.377485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1282/2556] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:25.382953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.392489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95e0b2-6260-4c0b-a5ee-83be8fefda8f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.397417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.398019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.398306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.398584 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.399474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.432641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.475952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1275/2557] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:25.481524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.494405 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06da27-14e8-4053-aa29-739b9904220d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.610797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.612286 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.614265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.615835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.616941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.653845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.682732 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1283/2558] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:25.683193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.696341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae9595-7ef0-4bbe-907f-95509a709b79 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.701230 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.702139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.703023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.703545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.704711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.750169 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bbcfa-65c7-4c94-8461-5a7e6b1fe7ab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.768726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1276/2559] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:25.770852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.780676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39d2e-78e5-4871-9ddf-66cd3a5db508 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.789213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.790234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.791569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.792002 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] PATH_INFO: `/v3/projects/e394737cefeb402683f33f535167963e/users/65695b1cfdab4db0b372c729b70ef972/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.826601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e394737cefeb402683f33f535167963e, user_id=65695b1cfdab4db0b372c729b70ef972, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:25.855873 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.870635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1284/2560] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:25 2022] PUT /identity/v3/projects/e394737cefeb402683f33f535167963e/users/65695b1cfdab4db0b372c729b70ef972/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:25.881177 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.881599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.882003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.922313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] MFA Rules not processed for user `65695b1cfdab4db0b372c729b70ef972`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:25.923885 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.009659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1277/2561] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:26.014021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.121746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.123268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.125687 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f81b-d27f-4b6a-b62a-b231094d8096 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.130586 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.131371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.131577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.131842 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.132488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.138406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad50779-0ac6-4db3-94e0-b4b7299bae37 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.143361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.144162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.145050 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.145441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] PATH_INFO: `/v3/users/f7cf97b0aa15496393f1a39d5ef759de` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.146565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cf97b0aa15496393f1a39d5ef759de)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.158914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.173391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.185810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1285/2562] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:26 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:26.190552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.233165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cf97b0aa15496393f1a39d5ef759de'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.246453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cf97b0aa15496393f1a39d5ef759de'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.251680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cf97b0aa15496393f1a39d5ef759de'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.252931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cf97b0aa15496393f1a39d5ef759de'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.265241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cf97b0aa15496393f1a39d5ef759de'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.268455 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9fdf6-1789-4c4d-9c91-df906e6a1a8b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.273720 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.274297 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.274642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.275126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.275948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.283770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1278/2563] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:26 2022] DELETE /identity/v3/users/f7cf97b0aa15496393f1a39d5ef759de => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:26.320398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.348069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1286/2564] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:26 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:26.349645 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.351228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.453641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615982f-45b1-4655-9726-646d8ee69fa1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.459827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.461186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.461759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.462042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.462807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.488969 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.499594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1279/2565] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:26.503700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.513810 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c0e6a-6a80-4192-9331-5f46ab59541b admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.518258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.519022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.519992 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.520459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] PATH_INFO: `/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.542188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eb6585d8a340d4ad100761729efbcf, user_id=1879b2aef8f14b96a2008dfc2723e41d, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.561976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.566858 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.571734 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.596105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e7d0-8372-4cf0-9685-23a410bc9ddb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.598723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1287/2566] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:26 2022] PUT /identity/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:26.602890 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.676761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.677581 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.678039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.678380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] PATH_INFO: `/v3/projects/f673f0f0edd74c56a204930e93f143da` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.679588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f673f0f0edd74c56a204930e93f143da)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.706363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.761310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f673f0f0edd74c56a204930e93f143da', 'request_id': 'req-5ddbbe39-e9a7-4002-b776-27092a7977e4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.763320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846724-1178-4dc9-bf3a-a031bbd4481d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.770365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f673f0f0edd74c56a204930e93f143da', 'request_id': 'req-5ddbbe39-e9a7-4002-b776-27092a7977e4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.783525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f673f0f0edd74c56a204930e93f143da', 'request_id': 'req-5ddbbe39-e9a7-4002-b776-27092a7977e4'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.795060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] The token cache is being invalidate because project f673f0f0edd74c56a204930e93f143da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:26.795394 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.796143 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5ddbbe39-e9a7-4002-b776-27092a7977e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:26.798043 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1280/2567] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:26 2022] DELETE /identity/v3/projects/f673f0f0edd74c56a204930e93f143da => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:26.803224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbe49-f62c-4adb-b663-b4cbd0fd0157 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.803528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbe49-f62c-4adb-b663-b4cbd0fd0157 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.803819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbe49-f62c-4adb-b663-b4cbd0fd0157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.827724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a2efbe49-f62c-4adb-b663-b4cbd0fd0157 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:26.828899 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a2efbe49-f62c-4adb-b663-b4cbd0fd0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.829566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.830226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.830511 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.830827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.831518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.837422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1281/2568] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:26.844982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.845426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.845721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.858228 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.869385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1288/2569] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:26.870627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:26.871951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.873446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.874970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:26.879702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1282/2570] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:26.883960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.887859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1611db-f066-4d7c-8122-b6c0515f8ce2 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.893081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.893545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482aea0-47a9-4de4-a4d0-c74708f32f08 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:26.893895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.894185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.894548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] PATH_INFO: `/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.896424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eb6585d8a340d4ad100761729efbcf, user_id=1879b2aef8f14b96a2008dfc2723e41d, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.898539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:26.899277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:26.899579 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:26.899867 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:26.900563 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:26.900928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:26.923839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.928569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:26.935267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1289/2571] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:26 2022] PUT /identity/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:26.939211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.943438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1283/2572] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:26.947659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:26.959208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4ac45-bd73-4271-bb31-3389cf995288 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.018022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fee0-2369-4bc1-9a3a-eb3f8c244961 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.024023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.024199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.024683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.025066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.025901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.030806 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.031411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.031707 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.031995 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.032684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.052418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.060730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.065791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1290/2573] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:27.068272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.077963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0735-6f23-46d3-be25-819eeb80f34e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.082571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.083581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.083872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.084154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] PATH_INFO: `/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.086136 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eb6585d8a340d4ad100761729efbcf, user_id=1879b2aef8f14b96a2008dfc2723e41d, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.091718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1284/2574] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:26 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:27.095789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.113663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01069ab2-7d3b-42d0-ab69-f66780fbe15d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.127320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1291/2575] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:27 2022] PUT /identity/v3/projects/06eb6585d8a340d4ad100761729efbcf/users/1879b2aef8f14b96a2008dfc2723e41d/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:27.138456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.138823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.139116 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.171092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f60c95-6e67-41c8-8b57-e0ae03834696 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.178730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] MFA Rules not processed for user `1879b2aef8f14b96a2008dfc2723e41d`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:27.180005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:27.234340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.235072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.235440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.235789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.236439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.259989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1292/2576] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:27 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:27.262345 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.270996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.272826 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:27.287693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1285/2577] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:27 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:27.289066 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.298643 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3842361-b2d1-4618-bc22-c4b45086cec4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.304591 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.305183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.305474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.305762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.306462 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.332475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.340613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c0814-f5e3-4db4-bf13-01cb3b09549d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.346372 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1286/2578] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:27.346524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.346524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.346524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.346524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.348035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.355208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.357399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e48b-cf88-4bb3-ad2b-3b3449d2d81e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.361606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.362404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.362715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.363008 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] PATH_INFO: `/v3/projects/e3ff464e2f754ea6b93d69c7aab64732/users/27c8cb91dbfa4c569bc26c1dc9d4b157/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.381060 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb407b3-3317-48e7-a843-821f4bffe288 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.384486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ff464e2f754ea6b93d69c7aab64732, user_id=27c8cb91dbfa4c569bc26c1dc9d4b157, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.390828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1293/2579] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:27 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:27.413296 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.427671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1287/2580] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:27 2022] PUT /identity/v3/projects/e3ff464e2f754ea6b93d69c7aab64732/users/27c8cb91dbfa4c569bc26c1dc9d4b157/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:27.438568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.438894 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.439179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.480524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] MFA Rules not processed for user `27c8cb91dbfa4c569bc26c1dc9d4b157`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:27.482159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:27.504993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.566164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1294/2581] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:27 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:27.568005 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.575047 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608ab8c-3b46-4c2c-8cc3-52d8dfdf8523 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.579796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.580385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.580674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.580956 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.582759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:27.641866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811f3f-196d-475a-a1d5-833c05101509 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.646400 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.647017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.647308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.648037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.648324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.649883 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.676776 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.676994 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.687506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1288/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:27 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:27.710914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1295/2583] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:27 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:27.713069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.723821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efe26-35f0-44a5-8cf5-f112e909d3af service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.797030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.797756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.798057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.798342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.799092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.826777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.854469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1289/2584] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:27 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:27.856277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.867381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d183-8241-453d-bc40-57a8c369d40a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.871669 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.872260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.872549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.872827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.873518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.901295 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.913620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1296/2585] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:27.917234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:27.927417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95ce05-3aec-4596-8aa6-095c0a3baef2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:27.931641 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:27.932454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:27.932745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:27.933031 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] PATH_INFO: `/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:27.955111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8df978f01b340c09c3d60cddc45065e, user_id=9e85a198458b4eb9b725733f7b59b92f, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:27.981058 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:27.995318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1290/2586] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:27 2022] PUT /identity/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:27.999081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.010253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b122862-c3dc-4348-895a-f83a4abff7ff admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.076908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.077535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.077827 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.078114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.078843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.105399 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.117087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1297/2587] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:28.121171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.131260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe396ed9-7549-459b-9f5f-116ab08d60ae admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.135522 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.136339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.136632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.136920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] PATH_INFO: `/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.138977 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8df978f01b340c09c3d60cddc45065e, user_id=9e85a198458b4eb9b725733f7b59b92f, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.165683 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.176978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1291/2588] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:28 2022] PUT /identity/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:28.180990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.190697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b3a5b-8b39-4b6f-b48c-07d0a9062363 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.253285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.254029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.254314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.254602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.255324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.280835 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bda2b3-c4a1-4648-be47-0978289acffb admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.292158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1298/2589] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:28.296482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.307597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c012fb-31c8-4acf-8a7b-f1ccc02b2718 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.311942 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.312829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.313159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.313479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] PATH_INFO: `/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.315339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8df978f01b340c09c3d60cddc45065e, user_id=9e85a198458b4eb9b725733f7b59b92f, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.343301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.358166 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1292/2590] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:28 2022] PUT /identity/v3/projects/b8df978f01b340c09c3d60cddc45065e/users/9e85a198458b4eb9b725733f7b59b92f/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:28.369064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.369571 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.369665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.407739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] MFA Rules not processed for user `9e85a198458b4eb9b725733f7b59b92f`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:28.408889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:28.483843 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1299/2591] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:28.495259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.651785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63821-4b70-4506-b5c7-4dd1a63db124 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.655216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.655796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.656085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.656368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.666259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.691569 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.701463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1293/2592] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:28.803465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.813111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6ec58-16d2-44c7-a1d5-c3f8f1d9571d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.816954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.817626 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.817961 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.818283 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.915508 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:28.953291 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8b1b-9c13-4738-ad1d-3a658c8e9579 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.967057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1300/2593] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:30.790329 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:30.857952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b41b2-b084-4a6e-8dc4-08c05c9f7e50 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:30.862088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:30.862904 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:30.863375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:30.863722 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] PATH_INFO: `/v3/users/65695b1cfdab4db0b372c729b70ef972` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:30.864839 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65695b1cfdab4db0b372c729b70ef972)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:30.890709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:30.942456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65695b1cfdab4db0b372c729b70ef972'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:30.954318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65695b1cfdab4db0b372c729b70ef972'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:30.954993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65695b1cfdab4db0b372c729b70ef972'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:30.955594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65695b1cfdab4db0b372c729b70ef972'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:30.967760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65695b1cfdab4db0b372c729b70ef972'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:30.981734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1294/2594] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:30 2022] DELETE /identity/v3/users/65695b1cfdab4db0b372c729b70ef972 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:30.986566 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:30.987159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:30.987285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.013374 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:31.014748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.088098 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1301/2595] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:31.098804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.100134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.167834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1fef-08a4-45b9-b93f-7dcf0f5bd96e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:31.171285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:31.171871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.172213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.172460 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.181755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:31.208069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:31.217674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1295/2596] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:31.571202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.573365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.586507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc240eb-8729-481c-880f-f00b424eaeb0 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:31.591917 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:31.592793 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.593132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.593473 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] PATH_INFO: `/v3/projects/e394737cefeb402683f33f535167963e` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.594584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e394737cefeb402683f33f535167963e)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:31.622524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:31.675223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e394737cefeb402683f33f535167963e', 'request_id': 'req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.680661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e394737cefeb402683f33f535167963e', 'request_id': 'req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.692477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e394737cefeb402683f33f535167963e', 'request_id': 'req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.705433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] The token cache is being invalidate because project e394737cefeb402683f33f535167963e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:31.705702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.706300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.708043 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1302/2597] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:31 2022] DELETE /identity/v3/projects/e394737cefeb402683f33f535167963e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:31.712117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.721386 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152be99-dc70-422d-8d7b-1a32eb8a6083 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:31.787498 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:31.788355 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.788639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.788917 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] PATH_INFO: `/v3/users/1879b2aef8f14b96a2008dfc2723e41d` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.790006 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1879b2aef8f14b96a2008dfc2723e41d)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:31.817323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:31.872946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1879b2aef8f14b96a2008dfc2723e41d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.887855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1879b2aef8f14b96a2008dfc2723e41d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.888656 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1879b2aef8f14b96a2008dfc2723e41d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.889469 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1879b2aef8f14b96a2008dfc2723e41d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.897939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5f2ee7d7-84ff-4f61-8cdd-cb7af40f6638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1879b2aef8f14b96a2008dfc2723e41d'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.912149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1296/2598] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:31 2022] DELETE /identity/v3/users/1879b2aef8f14b96a2008dfc2723e41d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:32.352178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.354037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.366263 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc308-c7ee-4eb9-81c8-d20726aa4efe admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.437346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.438179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.438472 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.438790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] PATH_INFO: `/v3/projects/06eb6585d8a340d4ad100761729efbcf` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.439913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eb6585d8a340d4ad100761729efbcf)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:32.466792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.522066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eb6585d8a340d4ad100761729efbcf', 'request_id': 'req-5a18694d-b889-484e-9eaa-44850fd9e2e5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.527641 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eb6585d8a340d4ad100761729efbcf', 'request_id': 'req-5a18694d-b889-484e-9eaa-44850fd9e2e5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.539851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eb6585d8a340d4ad100761729efbcf', 'request_id': 'req-5a18694d-b889-484e-9eaa-44850fd9e2e5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.552901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] The token cache is being invalidate because project 06eb6585d8a340d4ad100761729efbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:32.553187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.553773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5a18694d-b889-484e-9eaa-44850fd9e2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.555496 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1303/2599] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:32 2022] DELETE /identity/v3/projects/06eb6585d8a340d4ad100761729efbcf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:32.560363 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.560668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.560925 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.584269 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:32.585432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.654415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1297/2600] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:32.663652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.663948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.664239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.686607 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:32.687795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.698606 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1304/2601] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:32.699992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.711248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429a09-09a8-40be-b5c7-5571f6997604 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.716271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.716737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.717094 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.717382 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.718479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:32.718604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:32.746434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.766393 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1298/2602] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:32.767552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.777581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f1b25-eb8f-4b81-9aad-da6616291688 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.781960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.782692 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.783020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.783293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.783952 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:32.809659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.842344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1305/2603] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:32.844309 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.854504 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c31de-b8d5-4c8e-a5f8-60e1973f91b5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.920131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.920737 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.921024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.921305 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.921935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:32.948916 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.973011 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1299/2604] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:32.976811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.996879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281267c-ae54-4e3f-8818-07cedcfd6c35 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.001960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.002770 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.003257 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.003763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.004621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.031200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977901-5585-4d88-be37-3a71d790b7cc admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.041620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1306/2605] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:33.045807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.055976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80f46a-7fef-4637-b582-b8f47bf4a311 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.060350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.061165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.061456 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.061740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] PATH_INFO: `/v3/projects/1415ca5161504659ac3e728a560df794/users/298258a524054862acccc9fe942cf91c/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.083353 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1415ca5161504659ac3e728a560df794, user_id=298258a524054862acccc9fe942cf91c, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.112626 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.127538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1300/2606] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:33 2022] PUT /identity/v3/projects/1415ca5161504659ac3e728a560df794/users/298258a524054862acccc9fe942cf91c/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:33.139211 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.139623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.139979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.177747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] MFA Rules not processed for user `298258a524054862acccc9fe942cf91c`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:33.178960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:33.257563 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1307/2607] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:33.261813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.336267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5093d-dfc5-4a69-925d-c800765331d1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.342232 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.342960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.343321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.343667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.344419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.371347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.406747 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1301/2608] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:33.411337 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.424898 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737757b-3fec-4ac5-9c3a-ef64c8f91144 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.500148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.500764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.501189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.501601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.502245 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.528325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.552172 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1308/2609] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:33.553328 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.564164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377d89-d416-48ac-b74e-8f58aa92b23a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.568803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.569404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.569723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.570009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.570736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.596562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.609553 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1302/2610] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:33.614089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.623691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0aaf-5ee7-4807-870e-a10384c9e42c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.627879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.628739 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.629354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.629645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] PATH_INFO: `/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.649746 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d432fe9c3d4b3aa0f599cd18042dc9, user_id=c0438d81d699484d9cf847e06f469964, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.677681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.694296 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1309/2611] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:33 2022] PUT /identity/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:33.698195 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.709903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c45223-00c4-489d-8b2f-e26616c652a3 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.782056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.782800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.783162 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.783514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.784284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.812375 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.823825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1303/2612] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:33.827922 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.838331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525a6c5-caa1-45ea-9dcd-a8fa59277284 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.842569 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.843461 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.843749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.844026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] PATH_INFO: `/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.845768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d432fe9c3d4b3aa0f599cd18042dc9, user_id=c0438d81d699484d9cf847e06f469964, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.872620 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.883083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1310/2613] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:33 2022] PUT /identity/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:33.886965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.897548 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4e4ea-7315-4f69-9cf8-1c9c640ca279 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.961339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.962111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.962608 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.962907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.963700 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:33.990528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139fd1c-ff98-4f6e-ad0d-bcf3654a4fe1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.005442 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1304/2614] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:34.006452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.017423 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057271c-f1bf-4fc6-baa0-e19114548700 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.025101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.026213 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.026756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.027266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] PATH_INFO: `/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.031954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d432fe9c3d4b3aa0f599cd18042dc9, user_id=c0438d81d699484d9cf847e06f469964, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:34.067691 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.100837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1311/2615] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:34 2022] PUT /identity/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9/users/c0438d81d699484d9cf847e06f469964/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:34.111965 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.112337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.112713 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.156562 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] MFA Rules not processed for user `c0438d81d699484d9cf847e06f469964`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:34.157796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.232760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1305/2616] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:34.242766 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.244567 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.311021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca9b7-65f3-4910-b28b-61ed9372754d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.314395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.315015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.315303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.315582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.326406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:34.351887 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50791e43-305b-4264-80e3-268fa0aeb5fa service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.362307 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1312/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:34.447762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.532379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f46e-fb71-4ca9-aeba-29fd49157fc3 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.537300 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.538124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.538411 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.538881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] PATH_INFO: `/v3/users/298258a524054862acccc9fe942cf91c` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.540088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298258a524054862acccc9fe942cf91c)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:34.569715 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.630211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298258a524054862acccc9fe942cf91c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:34.642400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298258a524054862acccc9fe942cf91c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:34.643139 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298258a524054862acccc9fe942cf91c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:34.643799 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298258a524054862acccc9fe942cf91c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:34.652909 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298258a524054862acccc9fe942cf91c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:34.666861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1306/2618] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:34 2022] DELETE /identity/v3/users/298258a524054862acccc9fe942cf91c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:34.671588 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.672152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.672268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.696618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:34.697824 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.771006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1313/2619] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:34.781283 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.782624 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.850194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f588-674d-4ba0-92d2-7ba79e474d51 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.853829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.854321 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.854609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.855062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.865474 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:34.890893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.901333 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1307/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:35.262976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:35.264322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:35.276210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b9cb3-063a-4ff2-a33f-658925a4b1b3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:35.281183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:35.282041 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:35.282449 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:35.282711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] PATH_INFO: `/v3/projects/1415ca5161504659ac3e728a560df794` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:35.283797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1415ca5161504659ac3e728a560df794)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:35.310509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:35.365385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1415ca5161504659ac3e728a560df794', 'request_id': 'req-2c67abd3-64fd-4d58-ae53-104218d12903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.370786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1415ca5161504659ac3e728a560df794', 'request_id': 'req-2c67abd3-64fd-4d58-ae53-104218d12903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.382695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1415ca5161504659ac3e728a560df794', 'request_id': 'req-2c67abd3-64fd-4d58-ae53-104218d12903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.396964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] The token cache is being invalidate because project 1415ca5161504659ac3e728a560df794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:35.397248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.397841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.399323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1314/2621] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:35 2022] DELETE /identity/v3/projects/1415ca5161504659ac3e728a560df794 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:35.403424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:35.413662 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf9f-1f62-4ac8-af50-c4f89a8d5d6e service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:35.477854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:35.478659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:35.478978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:35.479253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] PATH_INFO: `/v3/users/c0438d81d699484d9cf847e06f469964` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:35.480326 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0438d81d699484d9cf847e06f469964)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:35.506018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:35.552783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0438d81d699484d9cf847e06f469964'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.563913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0438d81d699484d9cf847e06f469964'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.564543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0438d81d699484d9cf847e06f469964'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.565115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0438d81d699484d9cf847e06f469964'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.572601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c494265-689e-4ff3-ad99-b174e33b5268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0438d81d699484d9cf847e06f469964'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:35.585273 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1308/2622] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:35 2022] DELETE /identity/v3/users/c0438d81d699484d9cf847e06f469964 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:35.952840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:35.954756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:35.969544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67abd3-64fd-4d58-ae53-104218d12903 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.045911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.046749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.047058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.047372 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] PATH_INFO: `/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.048463 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d432fe9c3d4b3aa0f599cd18042dc9)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.075909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.130627 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d432fe9c3d4b3aa0f599cd18042dc9', 'request_id': 'req-e7921092-03a1-4b19-8a24-7044810763e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:36.136027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d432fe9c3d4b3aa0f599cd18042dc9', 'request_id': 'req-e7921092-03a1-4b19-8a24-7044810763e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:36.149004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d432fe9c3d4b3aa0f599cd18042dc9', 'request_id': 'req-e7921092-03a1-4b19-8a24-7044810763e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:36.161845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] The token cache is being invalidate because project a9d432fe9c3d4b3aa0f599cd18042dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:36.162134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:36.162784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e7921092-03a1-4b19-8a24-7044810763e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:36.164203 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1315/2623] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:35 2022] DELETE /identity/v3/projects/a9d432fe9c3d4b3aa0f599cd18042dc9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:36.169063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.169587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.169792 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.197481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:36.198837 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:36.291539 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1309/2624] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:36.299234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.299565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.299880 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.322657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:36.323829 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:36.330742 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1316/2625] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:36.335067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.344637 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb154fe7-5582-46ee-8aa7-5087b6e8cf38 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.349565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.350154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.350437 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.350742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.351432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:36.351729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.377613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.391761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1310/2626] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:36.396294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.405132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe13f4-ad3c-41b2-8e67-166b49f7dec3 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.409584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.410767 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.410989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.411268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.411900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.438459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.467528 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1317/2627] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:36.471761 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.484652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856aafa-9003-4375-a8ac-8289370268a4 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.562063 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.562693 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.562981 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.563267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.563903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.590447 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.610751 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1311/2628] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:36.615936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.626029 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857a3e-852d-4d19-9ff8-6d24c2ddb180 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.630911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.631452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.631740 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.632018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.632712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.658226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3f2b-0b15-47ec-a6a2-cc40a4ea806a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.670564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1318/2629] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:36.675234 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.691432 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b505f-41f8-465d-af78-246b513f9ad8 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.697189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.698080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.698354 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.698630 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] PATH_INFO: `/v3/projects/b5561a7d813944d3ac5757375f4c51a3/users/158ca9638fc8481a9c3c6b0c7a3bdb3b/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.723331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5561a7d813944d3ac5757375f4c51a3, user_id=158ca9638fc8481a9c3c6b0c7a3bdb3b, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:36.753019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:36.768632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1312/2630] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:36 2022] PUT /identity/v3/projects/b5561a7d813944d3ac5757375f4c51a3/users/158ca9638fc8481a9c3c6b0c7a3bdb3b/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:36.782618 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.782999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.783294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.825865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] MFA Rules not processed for user `158ca9638fc8481a9c3c6b0c7a3bdb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:36.827092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:36.912380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1319/2631] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:36.916771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:36.992723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de825536-269b-4afd-836a-d0a750a1f07e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:36.997209 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:36.997804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:36.998134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:36.998508 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:36.999224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.027660 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.059026 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1313/2632] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:36 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:37.063231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.075694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf47b4-d606-4e8e-b951-88a2b96f27ef None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.147088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.147707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.148001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.148285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.148935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.184267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.208328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1320/2633] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:37 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:37.212420 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.223679 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f6fa-1dba-4d3c-9e00-cfbb75529ab7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.228931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.229552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.229868 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.230157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.230971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.262158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.281069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1314/2634] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:37.285682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.296817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7273d-37ad-4bff-b3fc-b3e7a207a86c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.305663 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.306519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.306847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.307178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] PATH_INFO: `/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.336239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac759d5384ff487cab426d527530e284, user_id=6bf8a0e3463d4b02b8d27902e3789534, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.365790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.379168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1321/2635] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:37 2022] PUT /identity/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:37.383453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.393576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be82cc-7922-4417-9e25-ad1418bf1763 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.459910 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.460418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.460709 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.460987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.461680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.487864 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.500229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1315/2636] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:37.504806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.514786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d55be-ec4f-4b38-a6dd-6149debffb39 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.518959 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.520369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.520656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.520935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] PATH_INFO: `/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.522797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac759d5384ff487cab426d527530e284, user_id=6bf8a0e3463d4b02b8d27902e3789534, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.549416 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.559716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1322/2637] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:37 2022] PUT /identity/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:37.563627 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.573103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e4ea0-0a48-4b0c-af2c-4a848ea67cda admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.637306 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.638158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.638446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.638876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.639564 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.665666 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9639f-ec5f-40e7-a525-d8b3c96a9d09 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.676081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1316/2638] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:37.680555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.690538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3f00-ff40-48f3-afec-089bd18803f7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.694901 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.695709 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.695998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.696278 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] PATH_INFO: `/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.698020 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac759d5384ff487cab426d527530e284, user_id=6bf8a0e3463d4b02b8d27902e3789534, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.726169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.742592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1323/2639] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:37 2022] PUT /identity/v3/projects/ac759d5384ff487cab426d527530e284/users/6bf8a0e3463d4b02b8d27902e3789534/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:37.753890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.754726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.755193 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.794552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] MFA Rules not processed for user `6bf8a0e3463d4b02b8d27902e3789534`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:37.795757 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:37.871636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1317/2640] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:37 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:37.882267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.883896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:37.946758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cefed8-bf8a-4fc4-855b-6fb7a18815c8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.950073 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.950648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.950965 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.951249 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.961071 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:37.986651 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.996356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1324/2641] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:37 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:38.100538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.110239 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35baaa-e11a-4ed5-b53b-915b9e14a4da None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.113632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.114785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.115074 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.115406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.181736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:38.207473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db8b4-2978-4ad7-a8ac-2d5f43b72f2a service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.216827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1318/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:38.585403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.656549 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e6c4-b610-470f-8d1a-1cded6b56597 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.661551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.662354 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.662642 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.662949 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] PATH_INFO: `/v3/users/158ca9638fc8481a9c3c6b0c7a3bdb3b` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.664037 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] RBAC: Authorizing `identity:delete_user(user_id=158ca9638fc8481a9c3c6b0c7a3bdb3b)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:38.690465 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.745148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158ca9638fc8481a9c3c6b0c7a3bdb3b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.752481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158ca9638fc8481a9c3c6b0c7a3bdb3b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.753363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158ca9638fc8481a9c3c6b0c7a3bdb3b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.753957 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158ca9638fc8481a9c3c6b0c7a3bdb3b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.761839 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158ca9638fc8481a9c3c6b0c7a3bdb3b'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.778804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1325/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:38 2022] DELETE /identity/v3/users/158ca9638fc8481a9c3c6b0c7a3bdb3b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:38.783256 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.783557 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.783861 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.807933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:38.809086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:38.875128 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1319/2644] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:38.885383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.886832 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:38.949811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc2b81-84a1-4f45-b001-1b281911095f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.953968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.953968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.954210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.954314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.963308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:38.989530 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.999395 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1326/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:39.444528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.446621 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:39.460320 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27668-aa7a-4fc3-8593-63db527367e9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.465726 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.466597 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.466984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.467339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] PATH_INFO: `/v3/projects/b5561a7d813944d3ac5757375f4c51a3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.469062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5561a7d813944d3ac5757375f4c51a3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:39.498869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.556123 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5561a7d813944d3ac5757375f4c51a3', 'request_id': 'req-b8b36d4f-a5e7-4e58-896a-d621153ca593'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.563102 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5561a7d813944d3ac5757375f4c51a3', 'request_id': 'req-b8b36d4f-a5e7-4e58-896a-d621153ca593'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.577470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5561a7d813944d3ac5757375f4c51a3', 'request_id': 'req-b8b36d4f-a5e7-4e58-896a-d621153ca593'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.585341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] The token cache is being invalidate because project b5561a7d813944d3ac5757375f4c51a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:39.585622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.586231 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.587667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1320/2646] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:39 2022] DELETE /identity/v3/projects/b5561a7d813944d3ac5757375f4c51a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:39.591817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.602153 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19573-5857-4ce6-aecc-ee1d64eeefc7 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.667851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.668594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.669008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.669159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] PATH_INFO: `/v3/users/6bf8a0e3463d4b02b8d27902e3789534` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.670250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf8a0e3463d4b02b8d27902e3789534)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:39.696509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.747302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf8a0e3463d4b02b8d27902e3789534'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.754840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf8a0e3463d4b02b8d27902e3789534'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.755442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf8a0e3463d4b02b8d27902e3789534'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.756048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf8a0e3463d4b02b8d27902e3789534'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.765148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-188bbf6f-5009-4f9e-9b31-555f59f6c23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf8a0e3463d4b02b8d27902e3789534'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.782888 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1327/2647] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:39 2022] DELETE /identity/v3/users/6bf8a0e3463d4b02b8d27902e3789534 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:40.171202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.173214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.186803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36d4f-a5e7-4e58-896a-d621153ca593 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.251110 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.251896 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.252181 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.252459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] PATH_INFO: `/v3/projects/ac759d5384ff487cab426d527530e284` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.253521 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac759d5384ff487cab426d527530e284)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.278912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.327224 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac759d5384ff487cab426d527530e284', 'request_id': 'req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.334525 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac759d5384ff487cab426d527530e284', 'request_id': 'req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.345732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac759d5384ff487cab426d527530e284', 'request_id': 'req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.356015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] The token cache is being invalidate because project ac759d5384ff487cab426d527530e284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:40.356295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.356876 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1b527dd-bd2a-4887-9ad9-8f18ca26922e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.358250 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1321/2648] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:40 2022] DELETE /identity/v3/projects/ac759d5384ff487cab426d527530e284 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:40.363683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.364018 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.364328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.385899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:40.387064 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.451558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1328/2649] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:40.459208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.459676 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.459825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.482101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:40.483262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.490163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1322/2650] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:40.494154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.503505 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e543a3-dcee-4ea3-9c7c-ec8088d18cf4 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.508090 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.508683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.508968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.509316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.510006 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:40.510327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.536874 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.552962 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1329/2651] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:40.557072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.565878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04e03-d699-4361-9232-01563c25d4d9 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.570200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.570846 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.571135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.571417 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.572060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.599061 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.625387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1323/2652] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:40.629522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.639359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4106e-85ce-40f7-9689-236fc4274729 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.702063 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.702582 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.702897 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.703175 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.703797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.730331 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.749662 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1330/2653] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:40.753950 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.763795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936aacb-37d9-46f6-a09b-c78befcf31dc admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.767999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.768587 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.768880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.769165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.770451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.795996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e3382-e8e6-47ba-974b-d0069435123c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.806208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1324/2654] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:40.810123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.819537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dcaf3-bcde-444c-81e1-a6936ec482fa admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.823725 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.824524 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.824814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.825117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] PATH_INFO: `/v3/projects/7d72fbf01405499a806745c202aa02ab/users/5847115ebe2c44d5aa126ca2647e2473/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.844624 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d72fbf01405499a806745c202aa02ab, user_id=5847115ebe2c44d5aa126ca2647e2473, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:40.871202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.883701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1331/2655] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:40 2022] PUT /identity/v3/projects/7d72fbf01405499a806745c202aa02ab/users/5847115ebe2c44d5aa126ca2647e2473/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:40.894152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.895055 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.895347 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.932282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] MFA Rules not processed for user `5847115ebe2c44d5aa126ca2647e2473`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:40.933440 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.011459 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1325/2656] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:41.016434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.087468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079ed10-0c43-4175-8d86-8d0e617b02a9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.091860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.092458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.092750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.093036 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.093672 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.119135 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.145062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1332/2657] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:41.149229 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.159614 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc08ec0-7f3c-46f5-81af-e3753b724f8b None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.228657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.229268 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.229555 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.229847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.230491 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.256544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.277636 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1326/2658] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:41.281814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.291783 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b2d0-b73a-4bc6-b1e3-940e1d4d967d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.296104 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.296701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.297049 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.297262 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.297964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.324281 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.336677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1333/2659] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:41.340863 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.351200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed258d-18c6-468c-9522-30064e061989 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.356105 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.356913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.357253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.357535 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] PATH_INFO: `/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.379175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=134771228c5e4206805980a0952420f6, user_id=540fa9c6215f4ad0aacc1079383f4332, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.406980 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.420731 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1327/2660] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:41 2022] PUT /identity/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:41.424841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.435966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5db00-8201-4dd7-8606-a6407968f46a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.504518 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.505359 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.505790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.506070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.506954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.534089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.544526 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1334/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:41.548827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.560060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135d2b7-9b62-4b31-b119-0e04622ca8dd admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.564316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.565125 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.565418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.565702 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] PATH_INFO: `/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.568623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134771228c5e4206805980a0952420f6, user_id=540fa9c6215f4ad0aacc1079383f4332, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.595048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.605892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1328/2662] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:41 2022] PUT /identity/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:41.609975 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.619991 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2314f-c37a-4cfc-b2c6-6382e4c5725c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.683384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.684026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.684321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.684659 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.685370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.711787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f62a48-a84b-432c-93db-250ef26c61ea admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.722343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1335/2663] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:41.726289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.736076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034c180-6e22-4751-83d8-06ea1c5a7d75 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.740435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.741237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.741524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.741805 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] PATH_INFO: `/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.743578 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134771228c5e4206805980a0952420f6, user_id=540fa9c6215f4ad0aacc1079383f4332, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:41.771299 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.784566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1329/2664] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:41 2022] PUT /identity/v3/projects/134771228c5e4206805980a0952420f6/users/540fa9c6215f4ad0aacc1079383f4332/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:41.795686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.795979 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.796264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.832886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] MFA Rules not processed for user `540fa9c6215f4ad0aacc1079383f4332`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:41.834026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.909376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1336/2665] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:41.919076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.920640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.992652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38ffeb-71b2-4aca-abce-d0adeac48fd5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.996395 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.996984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.997294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.997565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:42.062515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:42.088331 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f60c41-f304-4451-91cb-46cf64ca08f5 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:42.097045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1330/2666] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:42.580407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:42.581853 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:42.651998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc135ecf-d8a7-4e0f-b016-c225cd6a79f5 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:42.656016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:42.656799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:42.657087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:42.657364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] PATH_INFO: `/v3/users/27c8cb91dbfa4c569bc26c1dc9d4b157` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:42.658430 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c8cb91dbfa4c569bc26c1dc9d4b157)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:42.685065 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:42.734537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c8cb91dbfa4c569bc26c1dc9d4b157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:42.742425 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c8cb91dbfa4c569bc26c1dc9d4b157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:42.743042 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c8cb91dbfa4c569bc26c1dc9d4b157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:42.743623 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c8cb91dbfa4c569bc26c1dc9d4b157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:42.751343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c8cb91dbfa4c569bc26c1dc9d4b157'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:42.768486 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1337/2667] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:42 2022] DELETE /identity/v3/users/27c8cb91dbfa4c569bc26c1dc9d4b157 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:42.778497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:42.778497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:42.778497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:42.796808 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:42.797973 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:42.861911 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1331/2668] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:42.871907 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:42.873256 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:42.935635 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc820-362a-41c0-909a-089da1a82e62 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:42.938936 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:42.939505 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:42.939798 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:42.940167 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:42.949108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:42.975440 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:42.984658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1338/2669] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:43.330449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:43.332398 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:43.343796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767fcb-3287-4ed5-88f2-0dd4fc8158b1 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:43.348117 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:43.348901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:43.349189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:43.349573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] PATH_INFO: `/v3/projects/e3ff464e2f754ea6b93d69c7aab64732` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:43.350532 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ff464e2f754ea6b93d69c7aab64732)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:43.376067 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:43.425821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ff464e2f754ea6b93d69c7aab64732', 'request_id': 'req-bf406d6f-66d6-47ea-b90b-8601fcbe7976'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.432276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ff464e2f754ea6b93d69c7aab64732', 'request_id': 'req-bf406d6f-66d6-47ea-b90b-8601fcbe7976'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.443783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ff464e2f754ea6b93d69c7aab64732', 'request_id': 'req-bf406d6f-66d6-47ea-b90b-8601fcbe7976'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.453640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] The token cache is being invalidate because project e3ff464e2f754ea6b93d69c7aab64732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:43.453924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.454529 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.456258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1332/2670] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:43 2022] DELETE /identity/v3/projects/e3ff464e2f754ea6b93d69c7aab64732 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:43.461369 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:43.470610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f6adc-d94f-432d-8d7b-64f08fc61c4b service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:43.534656 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:43.535822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:43.536166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:43.536482 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] PATH_INFO: `/v3/users/9e85a198458b4eb9b725733f7b59b92f` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:43.537797 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e85a198458b4eb9b725733f7b59b92f)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:43.565821 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:43.614115 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e85a198458b4eb9b725733f7b59b92f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.621246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e85a198458b4eb9b725733f7b59b92f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.621845 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e85a198458b4eb9b725733f7b59b92f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.622435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e85a198458b4eb9b725733f7b59b92f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.630700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-e48c3e02-a5ad-45af-aaa1-14c3ac0c2fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e85a198458b4eb9b725733f7b59b92f'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:43.647516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1339/2671] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:43 2022] DELETE /identity/v3/users/9e85a198458b4eb9b725733f7b59b92f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:44.008385 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.010042 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:44.023260 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf406d6f-66d6-47ea-b90b-8601fcbe7976 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.093190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.093974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.094262 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.094545 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] PATH_INFO: `/v3/projects/b8df978f01b340c09c3d60cddc45065e` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.095652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8df978f01b340c09c3d60cddc45065e)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.122068 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.169524 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8df978f01b340c09c3d60cddc45065e', 'request_id': 'req-27cec002-b6ef-47dd-883a-9ee210bc063b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:44.177119 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8df978f01b340c09c3d60cddc45065e', 'request_id': 'req-27cec002-b6ef-47dd-883a-9ee210bc063b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:44.188387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8df978f01b340c09c3d60cddc45065e', 'request_id': 'req-27cec002-b6ef-47dd-883a-9ee210bc063b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:44.197919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] The token cache is being invalidate because project b8df978f01b340c09c3d60cddc45065e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:44.198199 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:44.198817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-27cec002-b6ef-47dd-883a-9ee210bc063b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:44.200205 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1333/2672] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:44 2022] DELETE /identity/v3/projects/b8df978f01b340c09c3d60cddc45065e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:44.205113 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.205581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.205680 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.228230 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:44.229376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:44.293433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1340/2673] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:44.302696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.302993 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.303279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.324809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:44.325946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:44.333404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1334/2674] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:44.337451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.346581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5e7f-bf3b-4f5f-8f10-d13454f68c20 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.351558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.352134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.352420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.352697 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.353380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:44.353673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.378762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.393315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1341/2675] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:44.398057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.406879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369fe7f-11bb-48ef-afe8-5ae5b3cce48f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.411787 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.412370 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.412658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.412936 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.413601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.438895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.465426 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1335/2676] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:44.470009 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.480272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf083b-802d-4a1e-96e6-d998dc65f942 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.542052 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.542695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.542981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.543293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.543927 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.570268 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.589865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1342/2677] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:44.594098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.604574 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72138f23-e19a-4ea9-8ee7-7b75254f3a7f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.609325 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.609915 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.610200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.610479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.611216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.636873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd306-f74c-44f9-8a34-9bbea610ecdf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.647810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1336/2678] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:44.651970 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.662928 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542324de-6c9d-4da9-86f1-a8742d5adf50 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.667282 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.668099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.668419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.668702 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] PATH_INFO: `/v3/projects/c40e96911e684040a784430b6f4c3ef3/users/d242d35f32384a1b8448c1a47a62599b/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.689706 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40e96911e684040a784430b6f4c3ef3, user_id=d242d35f32384a1b8448c1a47a62599b, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.718105 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:44.731910 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1343/2679] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:44 2022] PUT /identity/v3/projects/c40e96911e684040a784430b6f4c3ef3/users/d242d35f32384a1b8448c1a47a62599b/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:44.742174 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.742475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.742793 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.783173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] MFA Rules not processed for user `d242d35f32384a1b8448c1a47a62599b`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:44.784341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:44.861528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1337/2680] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:44.866222 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:44.937379 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04b6c5-fa15-4bd8-a6e3-c3c6100fba75 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:44.947540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:44.948322 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:44.948448 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:44.948678 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:44.949345 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:44.977387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.006860 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1344/2681] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:44 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:45.010877 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.022842 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a911-81e2-4a20-a525-005a7f3c76b0 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.086887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.087499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.087796 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.088080 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.088721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.114951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.133721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1338/2682] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:45 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:45.138040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.148850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313fe3-0eb4-4a3f-8389-ac9e8236ff1e admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.152966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.153558 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.153847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.154127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.154852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.180555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.191401 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1345/2683] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:45.195550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.205134 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c77f20-d601-4aed-8300-e8af136841d9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.210135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.210992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.211288 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.211568 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] PATH_INFO: `/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.231736 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae10ea1c7644f29aa12ff31eaa8b2e6, user_id=1ea1c5e502774d3eb3a5100172c1a511, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.258212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.272397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1339/2684] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:45 2022] PUT /identity/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:45.276277 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.286260 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0523748-93be-4a0e-815c-ab35aae1d0d4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.354254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.354875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.355170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.355451 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.356152 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.381758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.391822 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1346/2685] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:45.396759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.406526 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da17d3-da71-4da7-a5c8-2ffe56c89dc1 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.411002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.411817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.412111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.412396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] PATH_INFO: `/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.414154 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae10ea1c7644f29aa12ff31eaa8b2e6, user_id=1ea1c5e502774d3eb3a5100172c1a511, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.448056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.460996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1340/2686] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:45 2022] PUT /identity/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:45.464780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.474368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693272b-5731-4a30-87ee-1507700db503 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.537248 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.537841 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.538164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.538446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.539195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.564076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b612a5-6866-44d6-afc1-c3c6f91d43c5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.574932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1347/2687] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:45.579207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.590079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aa9f8-905c-4eed-bc47-49df17cf3d03 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.594790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.595688 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.596056 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.596303 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] PATH_INFO: `/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.598289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae10ea1c7644f29aa12ff31eaa8b2e6, user_id=1ea1c5e502774d3eb3a5100172c1a511, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.624598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.640235 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1341/2688] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:45 2022] PUT /identity/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6/users/1ea1c5e502774d3eb3a5100172c1a511/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:45.650924 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.651271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.651557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.688091 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] MFA Rules not processed for user `1ea1c5e502774d3eb3a5100172c1a511`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:45.689239 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:45.764234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1348/2689] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:45.775368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.776970 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:45.839655 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb41f47-dbb4-46bf-861b-78a67ec60f68 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:45.843064 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:45.843642 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:45.843931 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:45.844214 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:45.853240 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:45.879330 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38c44-ec9a-4e7b-b8d1-9cd24d6ef84f service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:45.889974 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1342/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:45.934149 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:45.935763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.025923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e550d-aa88-4b4d-a6f1-1195b8fc038d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.030986 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.031885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.032314 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.032696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] PATH_INFO: `/v3/users/5847115ebe2c44d5aa126ca2647e2473` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.033941 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5847115ebe2c44d5aa126ca2647e2473)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:46.060958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:46.111480 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5847115ebe2c44d5aa126ca2647e2473'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.120191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5847115ebe2c44d5aa126ca2647e2473'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.120912 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5847115ebe2c44d5aa126ca2647e2473'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.121554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5847115ebe2c44d5aa126ca2647e2473'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.129958 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5847115ebe2c44d5aa126ca2647e2473'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.148234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1349/2691] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:45 2022] DELETE /identity/v3/users/5847115ebe2c44d5aa126ca2647e2473 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:46.155290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.155814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.155996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.179720 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:46.181085 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.254490 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1343/2692] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:46.263531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:46.264878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.331046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd98e84-cdfa-42fd-a48a-718c0517cc47 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.335311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.335931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.336243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.336523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.346597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:46.372723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dac94e-4300-4830-b924-1b16012055a2 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:46.383560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1350/2693] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:46.395533 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:46.396893 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.408360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f6965-3833-4f48-a2ed-05e78081329c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.413127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.413928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.414220 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.414506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] PATH_INFO: `/v3/users/d242d35f32384a1b8448c1a47a62599b` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.415640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d242d35f32384a1b8448c1a47a62599b)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:46.442449 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:46.493801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd242d35f32384a1b8448c1a47a62599b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.505902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd242d35f32384a1b8448c1a47a62599b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.506570 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd242d35f32384a1b8448c1a47a62599b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.507210 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd242d35f32384a1b8448c1a47a62599b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.515242 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd242d35f32384a1b8448c1a47a62599b'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.528829 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1344/2694] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:46 2022] DELETE /identity/v3/users/d242d35f32384a1b8448c1a47a62599b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:46.533143 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.533439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.533718 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.556114 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:46.557266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.629312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1351/2695] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:46.639935 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:46.641380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.704443 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bbf75-4b0f-4dc5-8192-f8d486782a4a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.708691 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.709274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.709617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.709902 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.718873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:46.744674 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:46.755315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1345/2696] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:46.765649 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:46.767267 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:46.779033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5253a-5aab-4793-be1c-f256eb48761e None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.783325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.784181 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.784541 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.784973 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] PATH_INFO: `/v3/projects/7d72fbf01405499a806745c202aa02ab` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.786383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d72fbf01405499a806745c202aa02ab)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:46.813590 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:46.867217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d72fbf01405499a806745c202aa02ab', 'request_id': 'req-26ad04e9-a93c-425f-a065-e91669e63c6d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.872164 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d72fbf01405499a806745c202aa02ab', 'request_id': 'req-26ad04e9-a93c-425f-a065-e91669e63c6d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.883690 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d72fbf01405499a806745c202aa02ab', 'request_id': 'req-26ad04e9-a93c-425f-a065-e91669e63c6d'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.896083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] The token cache is being invalidate because project 7d72fbf01405499a806745c202aa02ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:46.896367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.896960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:46.898378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1352/2697] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:46 2022] DELETE /identity/v3/projects/7d72fbf01405499a806745c202aa02ab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:46.902479 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:46.912718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe496c9d-a13a-4eef-bfeb-6771cad79ad9 service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:46.982454 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:46.983310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:46.983598 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:46.983897 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] PATH_INFO: `/v3/users/540fa9c6215f4ad0aacc1079383f4332` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:46.984986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540fa9c6215f4ad0aacc1079383f4332)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.011475 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.062051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540fa9c6215f4ad0aacc1079383f4332'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.076414 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540fa9c6215f4ad0aacc1079383f4332'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.077465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540fa9c6215f4ad0aacc1079383f4332'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.078149 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540fa9c6215f4ad0aacc1079383f4332'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.086638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540fa9c6215f4ad0aacc1079383f4332'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.100342 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1346/2698] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:46 2022] DELETE /identity/v3/users/540fa9c6215f4ad0aacc1079383f4332 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:47.133251 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.134753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.148711 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad04e9-a93c-425f-a065-e91669e63c6d admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:47.213577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:47.214542 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.214931 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.215319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] PATH_INFO: `/v3/projects/c40e96911e684040a784430b6f4c3ef3` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.216557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40e96911e684040a784430b6f4c3ef3)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.243599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.301162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40e96911e684040a784430b6f4c3ef3', 'request_id': 'req-c44a2317-e10a-402a-8a2f-52f137e72415'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.311138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40e96911e684040a784430b6f4c3ef3', 'request_id': 'req-c44a2317-e10a-402a-8a2f-52f137e72415'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.328812 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40e96911e684040a784430b6f4c3ef3', 'request_id': 'req-c44a2317-e10a-402a-8a2f-52f137e72415'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.344935 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] The token cache is being invalidate because project c40e96911e684040a784430b6f4c3ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:47.345507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.345923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.347988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1353/2699] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:47 2022] DELETE /identity/v3/projects/c40e96911e684040a784430b6f4c3ef3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:47.352294 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.353706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.366275 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4369-0e98-4acc-a53d-deb63f240d19 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:47.437357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:47.438310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.439133 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.439513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] PATH_INFO: `/v3/users/1ea1c5e502774d3eb3a5100172c1a511` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.440717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea1c5e502774d3eb3a5100172c1a511)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.467257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.499426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.501589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.517809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2317-e10a-402a-8a2f-52f137e72415 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:47.523516 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:47.524210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.524703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.524989 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] PATH_INFO: `/v3/projects/134771228c5e4206805980a0952420f6` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.526191 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=134771228c5e4206805980a0952420f6)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.529992 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea1c5e502774d3eb3a5100172c1a511'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.542528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea1c5e502774d3eb3a5100172c1a511'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.543424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea1c5e502774d3eb3a5100172c1a511'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.544280 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea1c5e502774d3eb3a5100172c1a511'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.553249 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-b1a37d7e-f464-4926-8cc2-3f8ccbf18df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea1c5e502774d3eb3a5100172c1a511'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.553696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.568201 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1347/2700] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:47 2022] DELETE /identity/v3/users/1ea1c5e502774d3eb3a5100172c1a511 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:47.607531 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134771228c5e4206805980a0952420f6', 'request_id': 'req-8c210274-4c4c-4056-86ea-39af4bb22396'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.613358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134771228c5e4206805980a0952420f6', 'request_id': 'req-8c210274-4c4c-4056-86ea-39af4bb22396'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.624695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134771228c5e4206805980a0952420f6', 'request_id': 'req-8c210274-4c4c-4056-86ea-39af4bb22396'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.638657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] The token cache is being invalidate because project 134771228c5e4206805980a0952420f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:47.639198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.639947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-8c210274-4c4c-4056-86ea-39af4bb22396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:47.641801 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1354/2701] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:47 2022] DELETE /identity/v3/projects/134771228c5e4206805980a0952420f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:47.646782 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.647073 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.647500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.673778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:47.675482 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.749534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1348/2702] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:47.757644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.758338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.758338 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.782580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:47.783782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.791145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1355/2703] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:47.795423 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.804979 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97d693-0295-4210-a2a3-b7195cfe87ed None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:47.809406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:47.810086 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.810451 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.810844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.811617 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:47.812259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.839463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.854136 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1349/2704] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:47.858437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.867764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc568d-ab8f-46b6-822d-fcb31e15eb66 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:47.872390 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:47.873150 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:47.873442 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:47.873784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:47.874646 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:47.901805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:47.936791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.939553 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1356/2705] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:47 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:47.940245 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:47.944577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:47.957680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa829-71f3-46e7-a58b-a3100f89477b admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.026772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19c87d-99d4-4abd-916e-fa39d6660c69 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.032199 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.033148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.033148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.033361 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.033980 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.045955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.046779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.047076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.047358 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] PATH_INFO: `/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.048483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae10ea1c7644f29aa12ff31eaa8b2e6)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.061661 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.075497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.087092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1357/2706] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:47 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:48.088236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.099159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97dec5-6b30-418d-a8f2-c710c4487e02 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.103180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.103850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.104259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.104576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.105388 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.127565 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae10ea1c7644f29aa12ff31eaa8b2e6', 'request_id': 'req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:48.132682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.136131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae10ea1c7644f29aa12ff31eaa8b2e6', 'request_id': 'req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:48.146814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1358/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:48.148873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae10ea1c7644f29aa12ff31eaa8b2e6', 'request_id': 'req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:48.149028 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.159983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] The token cache is being invalidate because project 3ae10ea1c7644f29aa12ff31eaa8b2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:48.160388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:48.161129 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-f9f6c699-9b0e-4f9e-b3b0-5806f77ff76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:48.161259 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea872-919f-4dc4-ac05-cb55ed7b229c admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.163247 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1350/2708] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:47 2022] DELETE /identity/v3/projects/3ae10ea1c7644f29aa12ff31eaa8b2e6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:48.171881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357d9a-da5d-4f7f-8ef9-da2063d8276b None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.172387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357d9a-da5d-4f7f-8ef9-da2063d8276b None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.172773 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357d9a-da5d-4f7f-8ef9-da2063d8276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.203285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a2357d9a-da5d-4f7f-8ef9-da2063d8276b None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:48.204888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a2357d9a-da5d-4f7f-8ef9-da2063d8276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:48.245310 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.246287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.246701 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.247086 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] PATH_INFO: `/v3/projects/808cc1b3def14c1f8ea4f6635967b351/users/31758734d70b471081c8262b0492bc56/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.267637 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808cc1b3def14c1f8ea4f6635967b351, user_id=31758734d70b471081c8262b0492bc56, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.294018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1351/2709] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:48.297830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a353c30-dc51-4eb2-a474-3de2667da547 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.301945 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.302248 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.302534 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.319535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1359/2710] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:48 2022] PUT /identity/v3/projects/808cc1b3def14c1f8ea4f6635967b351/users/31758734d70b471081c8262b0492bc56/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:48.321865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.321865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.322450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.326894 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:48.328049 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:48.346370 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:48.348217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:48.404594 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1352/2711] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:48.405659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.415929 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffc84-2643-4c65-a1ff-274327088563 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.421544 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.422513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.423007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.423446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.425104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:48.425104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.425523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1360/2712] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:48.435806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.437579 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:48.454017 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.472717 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1353/2713] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:48.474583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.486804 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6082b-c58a-446e-a26a-8a333e1cd13f admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.491552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.492227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.492586 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.492955 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.493672 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.520676 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9c99-52cf-4350-b7be-1077c3b82735 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.524173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.524906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.525344 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.525869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.527661 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.538070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.567847 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.569489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1354/2714] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:48.573207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.579039 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1361/2715] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:48.681252 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791fa2d-4848-4e85-a654-2288992261cb admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.685740 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.686344 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.686813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.687018 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.687596 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.714263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.734537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1355/2716] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:48.739629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.749728 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2216-630b-4d58-9197-b1d6a3c7ca93 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.754462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.755208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.755564 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.755940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.756660 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.782795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443db06-f200-4785-9adf-b9d6b49e3d55 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.795054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1362/2717] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:48.800035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:48.813079 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b79fe-1419-40a9-a6e8-98872d5c9736 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:48.822770 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:48.823756 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.824059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.824406 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] PATH_INFO: `/v3/projects/496634e5ac11445784d343f046328356/users/a7507e369d7a4bcabea1bbd44e7c1b01/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.854153 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496634e5ac11445784d343f046328356, user_id=a7507e369d7a4bcabea1bbd44e7c1b01, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:48.889416 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:48.914987 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1356/2718] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:48 2022] PUT /identity/v3/projects/496634e5ac11445784d343f046328356/users/a7507e369d7a4bcabea1bbd44e7c1b01/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:48.925147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.925895 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.926477 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.977764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] MFA Rules not processed for user `a7507e369d7a4bcabea1bbd44e7c1b01`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:48.979154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.113056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1363/2719] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3704 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:49.117422 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.209388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03fbde-d123-4c94-912f-a2515af487e7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.213856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.214458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.214779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.215071 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.215724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.246035 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe6d0d-cf6b-44fc-bc91-a7a145302714 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.279789 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1357/2720] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:49 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:49.284885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.301554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2c00-2d63-4fef-8d69-cd7fbcd68356 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.393540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.394315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.394724 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.395011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.395817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.426319 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.450243 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b74fe-9061-4ed7-afa2-5b951f45629e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.450881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b74fe-9061-4ed7-afa2-5b951f45629e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.450881 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b74fe-9061-4ed7-afa2-5b951f45629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.464265 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1364/2721] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:49 2022] POST /identity/v3/users => generated 307 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:49.465899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.479159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8cc1-f2e9-4b6b-921e-294873fea6d4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.485058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.485759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d63b74fe-9061-4ed7-afa2-5b951f45629e None None] MFA Rules not processed for user `6d94e2a615ab42aaa79b7c8470f7808a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:49.485913 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.486386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.486700 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.486958 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d63b74fe-9061-4ed7-afa2-5b951f45629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.487414 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.524301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.543609 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1365/2722] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:49.548070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.559708 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68efd64-79a0-4a27-b894-eac63824b945 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.565141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.566495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.566932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.567378 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] PATH_INFO: `/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.592040 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=334639dea8fb4892a730456b1c755ca4, user_id=c0a7cfcccc1b4b89b74868c5bb08489a, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.614724 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1358/2723] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:49.644661 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.645215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.645592 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.652685 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.674437 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1366/2724] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:49 2022] PUT /identity/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:49.679134 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.698267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] MFA Rules not processed for user `31758734d70b471081c8262b0492bc56`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:49.699759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.782107 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045ae71-2937-4dfd-aad3-f4331810725f admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.790196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.791054 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.791418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.791769 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.792551 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.811263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1359/2725] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:49.818890 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.820530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.833413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.866078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1367/2726] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:49.870919 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.892856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7056e7-af10-458a-8ab9-f257bd229ef8 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.911148 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.911998 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.912308 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.912595 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] PATH_INFO: `/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/25829623b314474f90be394caa52cb01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.917271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334639dea8fb4892a730456b1c755ca4, user_id=c0a7cfcccc1b4b89b74868c5bb08489a, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.921238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3dac-6d5d-4d0d-ae69-ecbb2eccbe0c None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.926020 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.926971 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.927898 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.928297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.938281 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:49.959868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.974291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.974529 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1368/2727] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:49 2022] PUT /identity/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:49.989188 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:50.004647 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1360/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:50.168160 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559bf06-9865-4d0e-b3e2-b9032831a972 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:50.172749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:50.173363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.173946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.174236 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.175001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:50.203599 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:50.219367 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1369/2729] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:50.221400 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:50.235845 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214673-524e-4dcf-8ec9-ada7984ed7d0 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:50.247457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:50.248721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.249113 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.249496 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] PATH_INFO: `/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.251481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334639dea8fb4892a730456b1c755ca4, user_id=c0a7cfcccc1b4b89b74868c5bb08489a, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:50.281930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60193c44-a0a7-441c-a353-e340fc546ca7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:50.311092 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1361/2730] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:50 2022] PUT /identity/v3/projects/334639dea8fb4892a730456b1c755ca4/users/c0a7cfcccc1b4b89b74868c5bb08489a/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:50.312481 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:50.314294 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:50.318743 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.322091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.323776 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.372506 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] MFA Rules not processed for user `c0a7cfcccc1b4b89b74868c5bb08489a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:50.373768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:50.420997 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999fd2-118c-46b6-9f17-307f9dcbc586 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:50.489104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1362/2731] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3775 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:50.503160 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:50.505082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:50.505790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.506082 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.506363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.508252 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:50.522909 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:50.555215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:50.567645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1370/2732] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:50.593357 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7cdd3-6d3b-4594-abef-525de8383dbb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:50.597798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:50.598492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.598807 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.599093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.610779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:50.645835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:50.688380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1363/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3775 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:50.798929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:50.812285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d5b0-7839-4b93-829e-106cef48cd02 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:50.815825 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:50.817070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:50.817365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:50.817707 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:50.888255 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:50.914546 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:50.923658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1371/2734] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3704 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:51.331097 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:51.333078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:51.451457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c36ae0-5009-497a-8ddf-a2f3d8d25300 service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:51.456127 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:51.457277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:51.457575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:51.457866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:51.459556 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:51.469976 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:51.497060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137fbf-175c-49fe-8853-e97d1aa78fc1 service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:51.507418 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1364/2735] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:51.602629 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:51.604111 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:51.625836 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2373-fb10-4919-8842-27e0e89db921 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:51.631074 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:51.631653 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:51.631943 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:51.632223 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:51.633896 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:51.645782 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:51.656810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6784-5e9b-4a11-9cee-87bdf0fc086e None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:51.657109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6784-5e9b-4a11-9cee-87bdf0fc086e None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:51.657397 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d6784-5e9b-4a11-9cee-87bdf0fc086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:51.671868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:51.680221 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-601d6784-5e9b-4a11-9cee-87bdf0fc086e None None] MFA Rules not processed for user `31758734d70b471081c8262b0492bc56`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:51.681371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-601d6784-5e9b-4a11-9cee-87bdf0fc086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:51.682202 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1372/2736] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:51.747453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1365/2737] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:55.609574 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:55.816696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973eb0f-7400-4100-b901-117b35dd40ea service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:55.821353 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:55.822174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:55.822462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:55.822779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] PATH_INFO: `/v3/users/a7507e369d7a4bcabea1bbd44e7c1b01` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:55.824187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7507e369d7a4bcabea1bbd44e7c1b01)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:55.850911 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:55.906589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7507e369d7a4bcabea1bbd44e7c1b01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:55.914324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7507e369d7a4bcabea1bbd44e7c1b01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:55.914948 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7507e369d7a4bcabea1bbd44e7c1b01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:55.915527 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7507e369d7a4bcabea1bbd44e7c1b01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:55.923272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7507e369d7a4bcabea1bbd44e7c1b01'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:55.941300 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1373/2738] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:55 2022] DELETE /identity/v3/users/a7507e369d7a4bcabea1bbd44e7c1b01 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:55.945888 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:55.947069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:55.947559 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:56.011991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:56.013461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:56.082213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1366/2739] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:56.092243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:56.093602 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:56.194170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270b666-da99-4f4a-9317-0fc63446ab89 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:56.198206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:56.199450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:56.199784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:56.200287 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:56.212976 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:56.239360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:56.249397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1374/2740] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:56.819387 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:56.821004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:56.835413 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aed22e-af1b-48c7-be00-10e8871fc7fb None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:56.839957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:56.840759 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:56.841052 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:56.841337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] PATH_INFO: `/v3/projects/496634e5ac11445784d343f046328356` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:56.842438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] RBAC: Authorizing `identity:delete_project(project_id=496634e5ac11445784d343f046328356)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:56.868131 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:56.919826 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496634e5ac11445784d343f046328356', 'request_id': 'req-ab0812cb-6728-4c0c-9756-780cc564241c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:56.927734 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496634e5ac11445784d343f046328356', 'request_id': 'req-ab0812cb-6728-4c0c-9756-780cc564241c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:56.939002 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496634e5ac11445784d343f046328356', 'request_id': 'req-ab0812cb-6728-4c0c-9756-780cc564241c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:56.950492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] The token cache is being invalidate because project 496634e5ac11445784d343f046328356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:56.951140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:56.951446 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:56.953130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1367/2741] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:56 2022] DELETE /identity/v3/projects/496634e5ac11445784d343f046328356 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:56.957509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:56.967993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a08fe-110a-4d6c-b155-5321f43bcf38 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:57.050493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:57.051495 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:57.051784 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:57.052062 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] PATH_INFO: `/v3/users/c0a7cfcccc1b4b89b74868c5bb08489a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:57.053139 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a7cfcccc1b4b89b74868c5bb08489a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:57.079522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:57.130210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a7cfcccc1b4b89b74868c5bb08489a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:57.138452 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a7cfcccc1b4b89b74868c5bb08489a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:57.139127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a7cfcccc1b4b89b74868c5bb08489a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:57.139713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a7cfcccc1b4b89b74868c5bb08489a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:57.148358 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-9b4114cd-ded4-4bb0-ba24-9681658148c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a7cfcccc1b4b89b74868c5bb08489a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:57.166743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1375/2742] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:56 2022] DELETE /identity/v3/users/c0a7cfcccc1b4b89b74868c5bb08489a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:58.208812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.210190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:58.222815 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0812cb-6728-4c0c-9756-780cc564241c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.285609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.286322 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.286610 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.286924 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] PATH_INFO: `/v3/projects/334639dea8fb4892a730456b1c755ca4` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.288007 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334639dea8fb4892a730456b1c755ca4)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:58.314513 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:58.364520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334639dea8fb4892a730456b1c755ca4', 'request_id': 'req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:58.371755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334639dea8fb4892a730456b1c755ca4', 'request_id': 'req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:58.383157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334639dea8fb4892a730456b1c755ca4', 'request_id': 'req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:58.393048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] The token cache is being invalidate because project 334639dea8fb4892a730456b1c755ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:58.393334 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:58.394336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-4c8fd2eb-9d1d-4e10-890e-9cd4d0576448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:58.395575 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1368/2743] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:58 2022] DELETE /identity/v3/projects/334639dea8fb4892a730456b1c755ca4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:58.400466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.400964 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.401190 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.461968 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:58.463154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:58.527885 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1376/2744] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:58.536301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.536520 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.536903 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.567515 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:58.568671 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:58.576180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1369/2745] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:58.580382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.590537 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56eea-9a1d-4ea2-83b7-ff7f0f1725ca None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.595140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.595830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.596121 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.596398 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.598004 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:56:58.598305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:58.623726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:58.636993 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1377/2746] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:58.641840 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.651465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a2b2-ab72-4c5e-ab59-679338f47e16 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.655779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.656402 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.656718 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.656999 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.657725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:58.684652 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:58.717777 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1370/2747] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:58 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:58.718589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.731089 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b2894-e6d3-4121-bdfd-91857340858a admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.800179 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.800849 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.801320 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.801621 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.805833 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:58.848559 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:58.872403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1378/2748] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:58 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:58.876464 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.888573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dd10e-9e63-4e55-ab98-2b752452cb45 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.892940 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.893538 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.894528 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.894978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.895684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:58.921267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d50242-b209-4989-bfed-444fd9064ad0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:58.942986 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1371/2749] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:58.943200 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:58.953016 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2bf3-b28b-4c08-afaa-bcd7aa4d4536 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:58.958639 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:58.959493 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:58.959795 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:58.960070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] PATH_INFO: `/v3/projects/509fa382bc674b9bb976f5250d0f7d19/users/497b3b24c6894f4abea6633306f708c8/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:58.981820 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=509fa382bc674b9bb976f5250d0f7d19, user_id=497b3b24c6894f4abea6633306f708c8, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.010312 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.029468 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1379/2750] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:58 2022] PUT /identity/v3/projects/509fa382bc674b9bb976f5250d0f7d19/users/497b3b24c6894f4abea6633306f708c8/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:59.039567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.039960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.040316 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.084616 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] MFA Rules not processed for user `497b3b24c6894f4abea6633306f708c8`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:59.085865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:59.246675 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1372/2751] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:56:59 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:59.251145 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.319686 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bf413-0ef7-4516-9907-0fc82ed2a2df admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.323794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.324382 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.324677 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.324956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.325581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.351415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.376577 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1380/2752] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:59 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:59.382237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.397272 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03d31c-6c19-41de-9886-f625e89c8b73 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.458257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.458878 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.459172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.459457 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.460101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.485595 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.506279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1373/2753] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:59 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:59.510387 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.520643 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070762-36c0-4565-aa43-e0e56ace9188 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.525183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.525790 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.526087 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.526375 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.527112 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.553828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.565173 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1381/2754] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:59.569847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.579259 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624002ed-ac56-4e53-91ff-6179cd807933 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.583631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.584431 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.584719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.584997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] PATH_INFO: `/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.604463 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b25998f5e642c7b6bdfc5f437aa019, user_id=17329bba73994d14aa20dbffd2c67f71, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.631135 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.644024 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1374/2755] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:59 2022] PUT /identity/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:59.647906 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.657534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6de1e-6304-4393-a968-d586f3a24634 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.718360 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.718969 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.719258 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.719538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.720225 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.746506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.756837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1382/2756] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:59.761039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.771041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413ccdf-91eb-45c6-baa1-6919f9a88f1e admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.775170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.775984 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.776270 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.776550 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] PATH_INFO: `/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/25829623b314474f90be394caa52cb01` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.778285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b25998f5e642c7b6bdfc5f437aa019, user_id=17329bba73994d14aa20dbffd2c67f71, role_id=25829623b314474f90be394caa52cb01)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.805512 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.815290 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1375/2757] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:59 2022] PUT /identity/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/25829623b314474f90be394caa52cb01 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:59.819183 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.828713 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5a143-310b-4f4c-bf77-f0a7467fa7f5 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.891864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.892384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.892674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.892954 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.893712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.919439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ca10-d546-4ded-9fcc-f4be57c35eb7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.929966 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1383/2758] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:59.934137 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:59.944107 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc63018-a35d-4b8a-a303-e2c81fefeec9 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:59.948368 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:59.949180 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:59.949472 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:59.949755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] PATH_INFO: `/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:59.951536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b25998f5e642c7b6bdfc5f437aa019, user_id=17329bba73994d14aa20dbffd2c67f71, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:56:59.978381 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:59.995814 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1376/2759] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:59 2022] PUT /identity/v3/projects/88b25998f5e642c7b6bdfc5f437aa019/users/17329bba73994d14aa20dbffd2c67f71/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:00.006868 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.007284 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.007837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.045900 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] MFA Rules not processed for user `17329bba73994d14aa20dbffd2c67f71`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:00.047204 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:00.124346 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1384/2760] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:00 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:00.134145 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.135755 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:00.203206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02377a9-2699-4527-b314-4597ee5263f7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.207551 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.208141 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.208434 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.208779 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.220855 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:00.247554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca588-1759-4ada-b28e-8f74c95d0357 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.258263 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1377/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:00 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:00.840859 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.908101 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc8da-eb42-4ff4-a46c-1f7dab5b985d None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.913019 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.913814 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.914099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.914380 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] PATH_INFO: `/v3/users/497b3b24c6894f4abea6633306f708c8` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.915554 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497b3b24c6894f4abea6633306f708c8)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:00.940955 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.989532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497b3b24c6894f4abea6633306f708c8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:00.996456 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497b3b24c6894f4abea6633306f708c8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:00.997024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497b3b24c6894f4abea6633306f708c8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:00.997610 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497b3b24c6894f4abea6633306f708c8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.005272 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497b3b24c6894f4abea6633306f708c8'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.022683 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1385/2762] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:00 2022] DELETE /identity/v3/users/497b3b24c6894f4abea6633306f708c8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:57:01.027146 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.027438 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.027719 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.050435 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:01.051622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:01.118623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1378/2763] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:01.129407 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:01.130778 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:01.195050 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94762df-bb77-400d-a6ef-4606a0a729b9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:01.198538 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:01.199147 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.199435 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.199716 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.209215 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:01.234657 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:01.244426 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1386/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:57:01.699483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:01.701399 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:01.712729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044fe1-c3b9-4aaa-bcb5-ebbaccb0c858 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:01.717481 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:01.718213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.718499 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.718825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] PATH_INFO: `/v3/projects/509fa382bc674b9bb976f5250d0f7d19` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.719913 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509fa382bc674b9bb976f5250d0f7d19)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:01.746887 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:01.796834 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509fa382bc674b9bb976f5250d0f7d19', 'request_id': 'req-ac82f54a-7cde-4529-9a40-c96256f876b5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.804186 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509fa382bc674b9bb976f5250d0f7d19', 'request_id': 'req-ac82f54a-7cde-4529-9a40-c96256f876b5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.815111 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509fa382bc674b9bb976f5250d0f7d19', 'request_id': 'req-ac82f54a-7cde-4529-9a40-c96256f876b5'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.825622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] The token cache is being invalidate because project 509fa382bc674b9bb976f5250d0f7d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:01.825822 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.826419 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.827824 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1379/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:01 2022] DELETE /identity/v3/projects/509fa382bc674b9bb976f5250d0f7d19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:01.831884 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:01.840944 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41529299-42d2-4128-97f2-5fe36309876d service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:01.903730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:01.904520 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.904805 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.905078 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] PATH_INFO: `/v3/users/17329bba73994d14aa20dbffd2c67f71` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.906138 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17329bba73994d14aa20dbffd2c67f71)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:01.932336 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:01.981217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17329bba73994d14aa20dbffd2c67f71'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.989076 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17329bba73994d14aa20dbffd2c67f71'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.989674 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17329bba73994d14aa20dbffd2c67f71'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.990243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17329bba73994d14aa20dbffd2c67f71'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:01.997799 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b854fd08-d568-42f0-b896-a5945a9e684c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17329bba73994d14aa20dbffd2c67f71'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.014929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1387/2766] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:01 2022] DELETE /identity/v3/users/17329bba73994d14aa20dbffd2c67f71 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:02.359725 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:02.361095 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:02.372760 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82f54a-7cde-4529-9a40-c96256f876b5 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:02.435081 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:02.435866 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.436157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.436439 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] PATH_INFO: `/v3/projects/88b25998f5e642c7b6bdfc5f437aa019` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.437516 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b25998f5e642c7b6bdfc5f437aa019)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:02.463797 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:02.514001 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b25998f5e642c7b6bdfc5f437aa019', 'request_id': 'req-64f7b9e0-e555-4163-883b-80472391301e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.520429 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b25998f5e642c7b6bdfc5f437aa019', 'request_id': 'req-64f7b9e0-e555-4163-883b-80472391301e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.532225 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b25998f5e642c7b6bdfc5f437aa019', 'request_id': 'req-64f7b9e0-e555-4163-883b-80472391301e'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.542258 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] The token cache is being invalidate because project 88b25998f5e642c7b6bdfc5f437aa019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:02.542536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.543179 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-64f7b9e0-e555-4163-883b-80472391301e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:02.544604 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1380/2767] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:02 2022] DELETE /identity/v3/projects/88b25998f5e642c7b6bdfc5f437aa019 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:02.549457 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.550279 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.550591 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.573730 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:02.574985 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:02.643562 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1388/2768] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:02.651404 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.651697 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.651978 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.688212 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:02.689541 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:02.698276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1381/2769] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:02.701665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:02.712418 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0d6db-fd20-4007-a1c2-9051da928937 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:02.717094 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:02.717763 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.718123 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.718444 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.719217 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:57:02.719519 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:02.746023 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:02.766705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:02.777795 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6ff32-3b27-4d82-9abd-c1fbc3ccc894 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:02.778305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1389/2770] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:57:02.783103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:02.783701 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.783991 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.784380 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.785030 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:02.812542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:02.838872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:02.841141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:02.851313 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1382/2771] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:02 2022] POST /identity/v3/projects => generated 361 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:02.851983 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:02.928424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a238fec-54d2-4d30-a061-5f59b9f4cb71 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:02.929999 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d3c8b-116a-4dd8-bedc-5fd3817483c3 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:02.933150 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:02.933919 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:02.934217 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:02.934509 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:02.935467 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:02.962633 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:02.986251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1383/2772] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:02 2022] POST /identity/v3/users => generated 281 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:02.990500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:03.000465 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9751f28-b666-439c-a423-16a4e792361c admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:03.005425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.006076 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.006458 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.006781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.007198 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.007483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:03.007914 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.008209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.008488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.010195 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:03.022864 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:03.035880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:03.046819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1384/2773] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:03.049140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d7b6b1-3890-450d-a536-6f762e0d6888 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:03.052013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:03.060768 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1390/2774] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:02 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:03.062396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90129-f121-48fb-96ad-30af59cbe4ab admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:03.066946 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.067766 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.068444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.068444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] PATH_INFO: `/v3/projects/16bcb5964c4c4f1ea58869720c82d404/users/12280ccce25b4a24af014d8ae315bb75/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.091241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bcb5964c4c4f1ea58869720c82d404, user_id=12280ccce25b4a24af014d8ae315bb75, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:03.120338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8c4db-ab17-4609-b71d-cff5d1b7cc06 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:03.136101 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1385/2775] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:03 2022] PUT /identity/v3/projects/16bcb5964c4c4f1ea58869720c82d404/users/12280ccce25b4a24af014d8ae315bb75/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:03.147787 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41036ca-600a-4e3a-88d2-e4b713c33e75 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.148122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41036ca-600a-4e3a-88d2-e4b713c33e75 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.148412 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41036ca-600a-4e3a-88d2-e4b713c33e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.186227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a41036ca-600a-4e3a-88d2-e4b713c33e75 None None] MFA Rules not processed for user `12280ccce25b4a24af014d8ae315bb75`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:03.187433 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a41036ca-600a-4e3a-88d2-e4b713c33e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:03.261650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1391/2776] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3668 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:03.288646 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367cd7-8573-4469-b9ad-503261dc2eba None None] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.288962 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367cd7-8573-4469-b9ad-503261dc2eba None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.289228 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7367cd7-8573-4469-b9ad-503261dc2eba None None] PATH_INFO: `/` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.290927 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1386/2777] 10.222.0.48 () {54 vars in 961 bytes} [Fri Apr 8 02:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:57:03.295681 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.295981 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.296266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.349458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] MFA Rules not processed for user `1331f8c76c344c1eba589f81eb365d18`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:03.350622 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:03.408539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1392/2778] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Apr 8 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:03.416623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367cd7-8573-4469-b9ad-503261dc2eba None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:03.427514 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7367cd7-8573-4469-b9ad-503261dc2eba None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:03.430791 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.431360 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.431650 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.431934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.440098 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:03.465222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ba5cc-95da-4090-8ffc-51e5ebe45bb0 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:03.474264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1387/2779] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3668 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:57:03.625889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:03.694177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef50982-a31f-45ef-9004-8a2d48a197eb None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:03.698206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.699026 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.699315 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.699594 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] PATH_INFO: `/v3/users/12280ccce25b4a24af014d8ae315bb75` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.700684 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12280ccce25b4a24af014d8ae315bb75)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:03.726568 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:03.773561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12280ccce25b4a24af014d8ae315bb75'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:03.780592 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12280ccce25b4a24af014d8ae315bb75'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:03.781328 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12280ccce25b4a24af014d8ae315bb75'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:03.781903 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12280ccce25b4a24af014d8ae315bb75'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:03.790141 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12280ccce25b4a24af014d8ae315bb75'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:03.806364 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1393/2780] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:03 2022] DELETE /identity/v3/users/12280ccce25b4a24af014d8ae315bb75 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:03.810871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.811361 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.811477 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.833930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:03.835122 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:03.901721 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1388/2781] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:03.912583 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:03.914027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:03.980645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b81a-6ac3-433e-86ce-4d87a7b9e9d7 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:03.984234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:03.984673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:03.984956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:03.985237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:03.994908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.021066 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2e0cd-2444-4c44-a9e9-c9f0e3210a5f service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.030803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1394/2782] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:04.393389 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:04.394765 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:04.405798 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8bcd-0ffa-4dd0-98b8-5d6e745f4e81 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:04.409960 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:04.411379 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.411668 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.411948 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] PATH_INFO: `/v3/projects/16bcb5964c4c4f1ea58869720c82d404` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.413036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bcb5964c4c4f1ea58869720c82d404)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.438800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.490089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bcb5964c4c4f1ea58869720c82d404', 'request_id': 'req-6fed9840-21a2-4250-ba4a-f6416b7c6379'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:04.498350 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bcb5964c4c4f1ea58869720c82d404', 'request_id': 'req-6fed9840-21a2-4250-ba4a-f6416b7c6379'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:04.509941 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bcb5964c4c4f1ea58869720c82d404', 'request_id': 'req-6fed9840-21a2-4250-ba4a-f6416b7c6379'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:04.519879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] The token cache is being invalidate because project 16bcb5964c4c4f1ea58869720c82d404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:04.520164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:04.520819 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6fed9840-21a2-4250-ba4a-f6416b7c6379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:04.522203 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1389/2783] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:04 2022] DELETE /identity/v3/projects/16bcb5964c4c4f1ea58869720c82d404 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:04.527108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.527498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.527852 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.553058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:04.554302 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:04.621780 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1395/2784] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:04.631140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.631764 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.632175 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.658012 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:04.659338 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:04.671631 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1390/2785] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:04.673351 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:04.683467 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354c401-5225-41ea-8e11-8a47385c1307 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:04.687695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:04.688184 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.688459 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.688736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.689434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66414) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:57:04.689830 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.717535 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.734237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1396/2786] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:57:04.738558 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:04.748658 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b4c29-380b-404e-a4ce-96cdd303ca50 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:04.753274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:04.753873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.754167 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.754470 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] PATH_INFO: `/v3/projects` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.756009 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.782060 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.809768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1391/2787] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:04 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:04.814057 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:04.824327 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a4f0c-2867-4ec8-b9f5-53aaa27427d0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:04.888001 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:04.888601 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.888893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.889171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] PATH_INFO: `/v3/users` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.889792 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.917170 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.937206 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1397/2788] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:04 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:04.941253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:04.951923 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617b18-af33-41bf-b912-698fcfeba188 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:04.956367 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:04.956964 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:04.957257 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:04.957543 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:04.958742 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:04.984708 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ef7f-70fb-4e2d-bb8b-a857a0f9c0a0 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:04.996461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1392/2789] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:05.000534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:05.010243 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeaac2-47db-454b-af1a-4955d6912d36 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:05.014875 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:05.015694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:05.016376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:05.016376 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] PATH_INFO: `/v3/projects/217aba6f4bb34d35bfc01c21fb7fc95a/users/3b24e5894c0e435a897a7d397109b4e3/roles/29d45dc2a84042c5837937965c286615` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:05.036937 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=217aba6f4bb34d35bfc01c21fb7fc95a, user_id=3b24e5894c0e435a897a7d397109b4e3, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:05.063301 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:05.076197 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1398/2790] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:04 2022] PUT /identity/v3/projects/217aba6f4bb34d35bfc01c21fb7fc95a/users/3b24e5894c0e435a897a7d397109b4e3/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:05.087124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a865-ed10-4759-a4ae-5b1578ff48c1 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:05.087424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a865-ed10-4759-a4ae-5b1578ff48c1 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:05.087714 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72a865-ed10-4759-a4ae-5b1578ff48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:05.125202 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-9f72a865-ed10-4759-a4ae-5b1578ff48c1 None None] MFA Rules not processed for user `3b24e5894c0e435a897a7d397109b4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:05.126369 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-9f72a865-ed10-4759-a4ae-5b1578ff48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:05.205659 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1393/2791] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:05.215411 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:05.217003 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:05.288929 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e11b-d527-4ec6-90e6-88fc44ea07cf admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:05.292507 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:05.293166 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:05.293525 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:05.294168 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:05.303348 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:05.329128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:05.339229 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1399/2792] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:05 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:06.835151 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2f71f-24b0-45ea-b557-cdfc1847ce45 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:06.836032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2f71f-24b0-45ea-b557-cdfc1847ce45 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:06.836497 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2f71f-24b0-45ea-b557-cdfc1847ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:06.860241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-29a2f71f-24b0-45ea-b557-cdfc1847ce45 None None] MFA Rules not processed for user `3b24e5894c0e435a897a7d397109b4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:06.861391 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-29a2f71f-24b0-45ea-b557-cdfc1847ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:06.868961 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1394/2793] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:09.678371 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:09.680723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:09.760356 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66601709-01bb-4f69-be49-e8bd76b6ffbe service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:09.764644 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:09.765196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:09.765499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:09.765779 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:09.767856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:09.854547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:09.885509 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:09.897499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1400/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:09 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:10.016264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc971d-3f1d-4a28-b4a8-e344c012052d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:10.016763 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc971d-3f1d-4a28-b4a8-e344c012052d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:10.017115 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc971d-3f1d-4a28-b4a8-e344c012052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:10.048124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-5fcc971d-3f1d-4a28-b4a8-e344c012052d None None] MFA Rules not processed for user `31758734d70b471081c8262b0492bc56`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:10.050051 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-5fcc971d-3f1d-4a28-b4a8-e344c012052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:10.123005 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1395/2795] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:10 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:13.443237 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:13.443781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:13.538132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dad2a-5721-4bc0-9423-3ec1d3f62997 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:13.543803 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:13.544485 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:13.544854 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:13.545192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:13.546918 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:13.559323 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:13.585879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:13.596617 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1401/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:23.603827 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa97b0-354d-4a83-816e-43d9229d1b1d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:23.604336 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa97b0-354d-4a83-816e-43d9229d1b1d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:23.604444 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa97b0-354d-4a83-816e-43d9229d1b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:23.626365 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2faa97b0-354d-4a83-816e-43d9229d1b1d None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:23.627536 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2faa97b0-354d-4a83-816e-43d9229d1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:23.688825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1396/2797] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:23.736048 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:23.737403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:23.810872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4578e-9b76-4adb-b0e5-a9484813cf27 service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:23.815434 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:23.816011 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:23.816293 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:23.816611 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:23.824872 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:23.850695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:23.859171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1402/2798] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:24.394489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c6bce-a8b1-4ff5-a21f-ab6e7f3d6ca4 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:24.394810 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c6bce-a8b1-4ff5-a21f-ab6e7f3d6ca4 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:24.395939 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c6bce-a8b1-4ff5-a21f-ab6e7f3d6ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:24.419172 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-2c9c6bce-a8b1-4ff5-a21f-ab6e7f3d6ca4 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:24.420284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-2c9c6bce-a8b1-4ff5-a21f-ab6e7f3d6ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:24.427264 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1397/2799] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:24.438597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:24.448750 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55ac2-0f52-4d23-aa5e-000d689e319c service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:24.453216 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:24.453855 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:24.454209 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:24.454555 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:24.462995 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:24.489305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:24.497696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1403/2800] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:24.715781 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6be8-4697-42ac-80d1-eb0e89f4c625 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:24.716307 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6be8-4697-42ac-80d1-eb0e89f4c625 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:24.716415 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6be8-4697-42ac-80d1-eb0e89f4c625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:24.739549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-b62e6be8-4697-42ac-80d1-eb0e89f4c625 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:24.740696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-b62e6be8-4697-42ac-80d1-eb0e89f4c625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:24.747062 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1398/2801] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:24.759733 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:24.770743 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a62b1-3dd2-49eb-8364-c6db8308f703 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:24.775470 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:24.776046 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:24.776333 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:24.776614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:24.784757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:24.810614 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:24.819698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1404/2802] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:57:25.166982 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:25.167284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:25.167573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:25.189034 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:25.190176 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:25.197039 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1399/2803] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:57:25 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:25.208682 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:25.218598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea94319-b664-4fc9-b23d-3776569a8ca1 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:25.223137 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:25.223703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:25.223990 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:25.224266 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:25.231947 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:25.257491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ed48f-66b6-49bf-91c9-e573e1d6384c service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:25.265415 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1405/2804] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:57:27.904778 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:27.972823 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f65fcc-0ff4-4f0c-83f0-d319fd7e8a3d None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:27.976848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:27.977639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:27.977926 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:27.978207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] PATH_INFO: `/v3/users/3b24e5894c0e435a897a7d397109b4e3` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:27.979337 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b24e5894c0e435a897a7d397109b4e3)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:28.006158 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:28.054768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b24e5894c0e435a897a7d397109b4e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.067048 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b24e5894c0e435a897a7d397109b4e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.067612 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b24e5894c0e435a897a7d397109b4e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.068190 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b24e5894c0e435a897a7d397109b4e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.076171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b24e5894c0e435a897a7d397109b4e3'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.088267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1400/2805] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:27 2022] DELETE /identity/v3/users/3b24e5894c0e435a897a7d397109b4e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:28.092785 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.093299 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.093424 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.116250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:28.117326 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:28.183581 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1406/2806] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:28.193396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:28.194800 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:28.259954 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b82bb6-b9ba-4a04-97dc-3ba7ca790fd2 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:28.263590 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:28.264163 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.264566 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.264851 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.274165 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:28.299349 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fc9fb-d261-4f09-983d-773b890e412a service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:28.308745 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1401/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:28.525565 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:28.527289 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:28.541818 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9fc7c-cbb4-4049-8fd5-bbaeabeac4e1 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:28.547208 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:28.548226 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.548512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.548791 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] PATH_INFO: `/v3/projects/217aba6f4bb34d35bfc01c21fb7fc95a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.549878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=217aba6f4bb34d35bfc01c21fb7fc95a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:28.576381 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:28.632383 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217aba6f4bb34d35bfc01c21fb7fc95a', 'request_id': 'req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.637589 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217aba6f4bb34d35bfc01c21fb7fc95a', 'request_id': 'req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.649119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217aba6f4bb34d35bfc01c21fb7fc95a', 'request_id': 'req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.661738 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] The token cache is being invalidate because project 217aba6f4bb34d35bfc01c21fb7fc95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:28.661956 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.662547 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-bd4aa723-e0d4-48a2-8d0a-2d42491cc09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:28.664231 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1407/2808] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:28 2022] DELETE /identity/v3/projects/217aba6f4bb34d35bfc01c21fb7fc95a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:28.668854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.669251 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.669599 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.693601 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:28.694794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:28.759953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1402/2809] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:28.767747 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.768155 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.768544 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.792093 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:28.793234 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:28.802800 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1408/2810] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:28.804341 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:28.814289 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3be5-1a42-4204-b6c5-833fbe5be280 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:28.819651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:28.820241 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.820531 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.820812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.821503 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:57:28.821803 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:28.847583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:28.860811 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1403/2811] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:57:28.865450 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:28.874932 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917b42-8d93-4e0d-9e61-2856e73baa69 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:28.880385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:28.881013 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:28.881402 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:28.881748 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:28.882462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:28.908819 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:28.937777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1409/2812] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:28 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:28.942157 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:28.951785 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7bf3d-527f-4d8f-90b3-13005e97ed05 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:29.021036 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:29.021711 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:29.022075 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:29.022441 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:29.023219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:29.049825 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:29.070103 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1404/2813] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:28 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:29.074445 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:29.085777 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e234a-b41b-45aa-8743-a02f157a22a9 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:29.090420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:29.091069 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:29.091363 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:29.091648 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:29.092357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:29.119340 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1553-36c9-4a28-9064-3f6dd457a14d admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:29.134439 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1410/2814] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:29.138852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:29.149873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46e5b-693d-4612-ace7-9bb14f714cd7 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:29.154164 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:29.155045 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:29.155339 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:29.155625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] PATH_INFO: `/v3/projects/c88c7ff5d25745a39df069dd80fe2876/users/01aecd15068645c88218db7f1d9396e0/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:29.177408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88c7ff5d25745a39df069dd80fe2876, user_id=01aecd15068645c88218db7f1d9396e0, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:29.205291 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:29.219461 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1405/2815] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:29 2022] PUT /identity/v3/projects/c88c7ff5d25745a39df069dd80fe2876/users/01aecd15068645c88218db7f1d9396e0/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:29.283083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a466-e46d-462c-b02c-8b787f0855b9 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:29.283384 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a466-e46d-462c-b02c-8b787f0855b9 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:29.283673 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a466-e46d-462c-b02c-8b787f0855b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:29.322368 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-8f69a466-e46d-462c-b02c-8b787f0855b9 None None] MFA Rules not processed for user `01aecd15068645c88218db7f1d9396e0`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:29.323561 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8f69a466-e46d-462c-b02c-8b787f0855b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:29.400652 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1411/2816] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3706 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:29.410921 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:29.412552 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:29.478692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ec98-4a9d-4d29-be99-59a764057940 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:29.482106 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:29.482706 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:29.482996 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:29.483277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:29.492388 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:29.518130 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:29.527219 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1406/2817] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:29 2022] GET /identity/v3/auth/tokens => generated 3706 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:34.611560 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:34.612027 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:34.612140 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:34.639092 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:34.640280 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:34.705431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1412/2818] 10.222.0.48 () {58 vars in 1014 bytes} [Fri Apr 8 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:34.717222 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:34.718573 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:34.794152 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64439d5b-e421-4b0a-8d49-eca43626d1aa service cinder] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:34.798618 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:34.799227 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:34.799519 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:34.799801 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:34.808318 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:34.834600 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69dea-604a-4e7e-aad2-2b8d851ec0eb service swift] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:34.842377 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1407/2819] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:43.493316 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:43.571321 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a48d7-55d6-4fc4-8694-8bd51cd59b08 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:43.575632 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:43.576436 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:43.576726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:43.577075 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] PATH_INFO: `/v3/users/01aecd15068645c88218db7f1d9396e0` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:43.580269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01aecd15068645c88218db7f1d9396e0)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:43.607180 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:43.662572 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01aecd15068645c88218db7f1d9396e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:43.670806 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01aecd15068645c88218db7f1d9396e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:43.671703 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01aecd15068645c88218db7f1d9396e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:43.672534 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01aecd15068645c88218db7f1d9396e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:43.681786 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01aecd15068645c88218db7f1d9396e0'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:43.700838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1413/2820] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:43 2022] DELETE /identity/v3/users/01aecd15068645c88218db7f1d9396e0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:57:43.705244 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:43.705739 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:43.705847 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:43.731274 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:43.732783 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:43.805892 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1408/2821] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:43.816324 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:43.817696 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:43.886421 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657958-48d0-463b-aefd-f5d2b0de62a4 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:43.890615 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:43.891275 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:43.891736 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:43.892022 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:43.901804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:43.928264 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:43.939357 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1414/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:44.430821 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:44.432667 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:44.449371 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6e9f-44f7-4482-83ba-af77c57eba04 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:44.467301 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:44.476549 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:44.476859 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:44.477144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] PATH_INFO: `/v3/projects/c88c7ff5d25745a39df069dd80fe2876` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:44.478468 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88c7ff5d25745a39df069dd80fe2876)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:44.511019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:44.571912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88c7ff5d25745a39df069dd80fe2876', 'request_id': 'req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:44.579816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88c7ff5d25745a39df069dd80fe2876', 'request_id': 'req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:44.592567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88c7ff5d25745a39df069dd80fe2876', 'request_id': 'req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:44.603830 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] The token cache is being invalidate because project c88c7ff5d25745a39df069dd80fe2876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:44.604004 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:44.604622 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-7024bcd4-483a-40c3-9b60-8ed3dd2bf599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:44.606144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1409/2823] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:44 2022] DELETE /identity/v3/projects/c88c7ff5d25745a39df069dd80fe2876 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:50.561385 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:50.563177 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:50.675971 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb77926-b137-4171-acf5-9ee0c395918d service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:50.747823 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:50.748419 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:50.748850 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:50.749142 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:50.750856 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:50.772723 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:50.798753 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:50.809721 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1415/2824] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:52.399215 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:52.399732 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:52.399843 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:52.421593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] MFA Rules not processed for user `308263fadbd147cc83233494ca6510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:52.422786 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:52.482901 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1410/2825] 10.222.0.48 () {58 vars in 967 bytes} [Fri Apr 8 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:52.495033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:52.496341 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:52.571132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a1d59-d2d0-4024-96a6-5469017266d9 service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:52.575552 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f1aa7e27de44da2a1dc7fcb1df0b74c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:52.576130 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:52.576422 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:52.576704 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:52.584409 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:52.609506 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:52.617773 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1416/2826] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:54.829632 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:54.831072 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:54.902236 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671aea0c-3cbf-465b-a621-2a853caf8f88 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:54.906453 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:54.907279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:54.907567 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:54.907848 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] PATH_INFO: `/v3/users/31758734d70b471081c8262b0492bc56` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:54.908930 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=31758734d70b471081c8262b0492bc56)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:54.935104 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:54.983729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31758734d70b471081c8262b0492bc56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:54.996090 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31758734d70b471081c8262b0492bc56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:54.996729 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31758734d70b471081c8262b0492bc56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:54.997297 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31758734d70b471081c8262b0492bc56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.005396 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-593ddf93-3bc8-407a-95f1-0adf7958fcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31758734d70b471081c8262b0492bc56'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.018233 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1411/2827] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:54 2022] DELETE /identity/v3/users/31758734d70b471081c8262b0492bc56 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:55.228749 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.239665 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401b6c-c622-4753-a479-b3ba82af0662 service swift] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.303726 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.304523 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.304815 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.305099 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] PATH_INFO: `/v3/projects/808cc1b3def14c1f8ea4f6635967b351` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.306171 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808cc1b3def14c1f8ea4f6635967b351)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.332804 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.380488 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808cc1b3def14c1f8ea4f6635967b351', 'request_id': 'req-6033faea-54a1-4e21-8930-2191d21a6ef5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.385479 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808cc1b3def14c1f8ea4f6635967b351', 'request_id': 'req-6033faea-54a1-4e21-8930-2191d21a6ef5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.397128 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808cc1b3def14c1f8ea4f6635967b351', 'request_id': 'req-6033faea-54a1-4e21-8930-2191d21a6ef5'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.408557 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] The token cache is being invalidate because project 808cc1b3def14c1f8ea4f6635967b351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66414) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:55.408809 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.409613 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-6033faea-54a1-4e21-8930-2191d21a6ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:55.411238 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1417/2828] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:55 2022] DELETE /identity/v3/projects/808cc1b3def14c1f8ea4f6635967b351 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:55.416032 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.416359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.416649 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.438947 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:55.440091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:55.506015 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1412/2829] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:55.564695 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.565021 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.565325 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.588196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:55.589339 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:55.596285 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1418/2830] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:55.600537 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.609852 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b228e95-adcf-4cd9-a695-c0338fbe1c87 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.615057 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.615638 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.615953 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.616276 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.616997 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Apr 08 02:57:55.617302 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.643216 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.656197 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1413/2831] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Apr 8 02:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:57:55.663247 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.672081 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce30d82-60d5-41f3-a9d0-7a614e9d62ab None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.677012 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.677612 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.677893 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.678176 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.678866 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.705015 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.732246 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1419/2832] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:55.736500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.746687 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b9803-ce36-409f-a4be-686e715fdb77 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.808054 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.808657 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.808951 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.809237 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] PATH_INFO: `/v3/users` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.809865 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.836424 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.855623 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1414/2833] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:55 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:55.859817 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.870169 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9131e7-ab56-4a5e-8bc6-1b2cc0c6b5e1 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.874303 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.874923 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.875214 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.875504 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] PATH_INFO: `/v3/roles` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.876192 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.901608 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f214c-f1a4-46a7-971d-c7e92fb3813b admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.912540 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1420/2834] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:55.916692 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:55.926684 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40a3d-26aa-40cc-bff0-e0d3586d273a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:55.930907 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:55.931723 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] REQUEST_METHOD: `PUT` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:55.932013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:55.932304 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] PATH_INFO: `/v3/projects/af176673833f4c0faaea380fa8eedf40/users/9169432db79e4ff086e920123f278903/roles/29d45dc2a84042c5837937965c286615` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:55.951869 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af176673833f4c0faaea380fa8eedf40, user_id=9169432db79e4ff086e920123f278903, role_id=29d45dc2a84042c5837937965c286615)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:55.978495 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:55.992124 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1415/2835] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:55 2022] PUT /identity/v3/projects/af176673833f4c0faaea380fa8eedf40/users/9169432db79e4ff086e920123f278903/roles/29d45dc2a84042c5837937965c286615 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:56.002889 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] REQUEST_METHOD: `POST` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:56.003185 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:56.003469 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:56.040154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.auth.core [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] MFA Rules not processed for user `9169432db79e4ff086e920123f278903`. Rule list: `[]` (Enabled: `True`). {{(pid=66414) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:56.041305 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:56.111196 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1421/2836] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:56.121144 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:56.122762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:56.212812 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065588d6-cf6f-4060-9c51-bd714e8a958a admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:56.216285 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:56.216920 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:56.217207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:56.217486 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:56.227835 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:57:56.252933 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dfa1c-0bcd-48b3-b626-128742a69069 service cinder] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:56.261768 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1416/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:56 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:58:06.854119 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:06.922058 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d37983-66fd-4f68-b304-0d5fd5b42b63 None None] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:06.926162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:06.927532 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:06.927828 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:06.928108 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] PATH_INFO: `/v3/users/9169432db79e4ff086e920123f278903` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:06.929189 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9169432db79e4ff086e920123f278903)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:58:06.954722 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:07.002650 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9169432db79e4ff086e920123f278903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.010498 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9169432db79e4ff086e920123f278903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.011122 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9169432db79e4ff086e920123f278903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.011851 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9169432db79e4ff086e920123f278903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.021146 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9169432db79e4ff086e920123f278903'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.038781 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1422/2838] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 02:58:06 2022] DELETE /identity/v3/users/9169432db79e4ff086e920123f278903 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:58:07.043173 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980482-bb11-4a0a-a723-00088125c305 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:07.043664 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980482-bb11-4a0a-a723-00088125c305 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:07.043771 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87980482-bb11-4a0a-a723-00088125c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:07.066189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-87980482-bb11-4a0a-a723-00088125c305 None None] MFA Rules not processed for user `53f94523980e4b8c8b9272803bd96ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:07.067895 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-87980482-bb11-4a0a-a723-00088125c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:07.132277 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1417/2839] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:58:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:58:07.142386 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:07.143757 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:07.207126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e997-9858-4609-ae63-a70d70d2f255 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:07.211187 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:07.211762 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:07.212051 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:07.212334 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:07.220892 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:58:07.245840 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:07.255432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1423/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:58:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:58:07.674988 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87980482-bb11-4a0a-a723-00088125c305 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:07.676873 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-87980482-bb11-4a0a-a723-00088125c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:07.688069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87980482-bb11-4a0a-a723-00088125c305 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:07.692794 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:07.693660 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:07.693862 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:07.694315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] PATH_INFO: `/v3/projects/af176673833f4c0faaea380fa8eedf40` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:07.695425 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=af176673833f4c0faaea380fa8eedf40)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:58:07.721767 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:07.772295 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af176673833f4c0faaea380fa8eedf40', 'request_id': 'req-79acb35b-bed1-409e-93c2-2ec11865c0af'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.778912 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af176673833f4c0faaea380fa8eedf40', 'request_id': 'req-79acb35b-bed1-409e-93c2-2ec11865c0af'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.790284 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af176673833f4c0faaea380fa8eedf40', 'request_id': 'req-79acb35b-bed1-409e-93c2-2ec11865c0af'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.799872 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] The token cache is being invalidate because project af176673833f4c0faaea380fa8eedf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:58:07.800159 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.800746 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-79acb35b-bed1-409e-93c2-2ec11865c0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:07.803089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1418/2841] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 02:58:07 2022] DELETE /identity/v3/projects/af176673833f4c0faaea380fa8eedf40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:59:34.611908 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:34.614033 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:34.624597 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce92e62-4e2b-4f12-9885-634fe8e4fa0a service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:34.681539 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:34.682127 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:34.682413 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:34.682712 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:34.684420 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:34.787311 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:59:34.813431 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:34.835017 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1424/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:59:34 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:59:36.001809 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:36.002384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:36.002384 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:36.025059 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] MFA Rules not processed for user `6d94e2a615ab42aaa79b7c8470f7808a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:59:36.026211 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:36.090427 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1419/2843] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:59:36.152120 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:36.153432 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:36.219253 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78590b-3e44-4683-be2a-4e9c9ebafeca service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:36.223070 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:36.223666 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:36.223963 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:36.224250 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:36.225960 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:36.239878 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:59:36.266162 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:36.278254 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1425/2844] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:59:36 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:59:51.814069 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:51.815583 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:51.826816 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d559-300e-432e-b6dc-32c62757c3d8 None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:51.830019 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:51.831091 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:51.831489 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:51.831769 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:51.833340 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:51.842078 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 02:59:51.867542 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070b3ef-2816-4281-868e-e42cddd8ad24 service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:51.875194 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1420/2845] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 02:59:51 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:01:41.677710 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:01:41.686458 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debd78-33b4-4693-a1b2-0da45e53729e service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:01:41.690219 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1331f8c76c344c1eba589f81eb365d18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:01:41.690838 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:41.691126 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:41.691403 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:41.693059 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:41.703512 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:01:41.729754 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:01:41.738631 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1426/2846] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:01:41 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:01:52.248576 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] REQUEST_METHOD: `POST` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:52.249088 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:52.249207 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:52.271891 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.auth.core [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] MFA Rules not processed for user `6d94e2a615ab42aaa79b7c8470f7808a`. Rule list: `[]` (Enabled: `True`). {{(pid=66413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 03:01:52.272957 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:52.279003 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1421/2847] 10.222.0.48 () {58 vars in 957 bytes} [Fri Apr 8 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 03:01:52.801406 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:01:52.802764 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:52.813865 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48012-45d6-431d-a10b-b12ed525f358 service cinder] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:01:52.817132 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:01:52.817698 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:52.817988 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:52.818269 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:52.819996 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:52.828994 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:01:52.854397 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:01:52.862788 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1427/2848] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:01:52 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:01:53.451189 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:01:53.452609 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:53.531606 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39b3f0-d46a-4866-93ab-0722ae05380f None None] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:01:53.536696 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:01:53.537282 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:53.537571 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:53.537879 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:53.539554 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:53.551171 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:01:53.576639 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:01:53.586841 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1422/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:01:53 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:01:53.681083 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:01:53.682394 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:53.696466 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524dd-425c-4b3b-ac85-9aebc4315034 service neutron] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:01:53.701008 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:01:53.701576 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:53.701871 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:53.702154 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:53.703772 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:53.714808 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:01:53.740174 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:01:53.749446 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1428/2850] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:01:53 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:01:56.581856 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:01:56.602625 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2e27-a7cd-4895-aba7-77d996ad3a80 service placement] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:01:56.608613 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:01:56.609213 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:01:56.609505 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:01:56.609790 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:01:56.611705 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:01:56.626854 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:01:56.654483 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:01:56.666817 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1423/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:01:56 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:08.228133 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:08.240977 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67ddf-a473-4fa7-943c-1877f3cdf217 service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:08.246144 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e40067b250f40d997dad1817ccbbba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:08.246758 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:08.247056 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:08.247342 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:08.249044 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:08.261462 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:02:08.286857 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:08.297869 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1429/2852] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:08 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:11.231185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:11.240952 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55feab9-23c0-4eac-b924-e6d6412385c6 service nova] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:11.244315 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:11.244889 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:11.245183 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:11.245471 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:11.247155 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:11.319077 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:02:11.344603 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:11.354492 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1424/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:11 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:54.499940 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:54.510543 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ed0b-b597-4072-9c7c-4fc84549c5c6 service nova] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:54.515343 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:54.515916 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:54.516210 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:54.516491 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:54.518645 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:54.529158 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:02:54.555658 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:54.565694 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1430/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:54 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:18.753109 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:18.761871 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc84dbd-65fd-476f-ab30-36c9cab8d0ef service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:18.765185 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21543ae332b47c88db79bc1fd6e127e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:18.765753 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] REQUEST_METHOD: `GET` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:18.766041 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:18.766323 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:18.768762 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:18.837206 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:04:18.862238 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:18.871408 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1425/2855] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:04:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:29.746080 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:29.747483 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:29.759879 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3ea87-01d9-45ba-9494-6ed14fbcfe72 service placement] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:29.764417 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:29.765227 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:29.765533 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:29.765794 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] PATH_INFO: `/v3/users/6d94e2a615ab42aaa79b7c8470f7808a` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:29.766902 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d94e2a615ab42aaa79b7c8470f7808a)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:04:29.793443 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:29.840362 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d94e2a615ab42aaa79b7c8470f7808a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:29.847813 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d94e2a615ab42aaa79b7c8470f7808a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:29.848499 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d94e2a615ab42aaa79b7c8470f7808a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:29.849182 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d94e2a615ab42aaa79b7c8470f7808a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:29.856756 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d94e2a615ab42aaa79b7c8470f7808a'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:29.873365 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1431/2856] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 03:04:29 2022] DELETE /identity/v3/users/6d94e2a615ab42aaa79b7c8470f7808a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:04:30.103271 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:30.113487 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f9e6d-e666-4ef1-8afc-7bb3f9aad71c service neutron] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:30.184298 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:30.185023 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:30.185310 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:30.185588 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] PATH_INFO: `/v3/projects/c89cf122bfb64dbca81527f5cac790a5` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:30.186651 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89cf122bfb64dbca81527f5cac790a5)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:04:30.213170 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:30.263730 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89cf122bfb64dbca81527f5cac790a5', 'request_id': 'req-e5d01199-23a6-4a25-a3fe-26e99e018b15'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.272253 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89cf122bfb64dbca81527f5cac790a5', 'request_id': 'req-e5d01199-23a6-4a25-a3fe-26e99e018b15'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.285359 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89cf122bfb64dbca81527f5cac790a5', 'request_id': 'req-e5d01199-23a6-4a25-a3fe-26e99e018b15'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.295593 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] The token cache is being invalidate because project c89cf122bfb64dbca81527f5cac790a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 03:04:30.295880 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.296500 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.297934 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1426/2857] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 03:04:30 2022] DELETE /identity/v3/projects/c89cf122bfb64dbca81527f5cac790a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:04:30.301899 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:30.303271 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:30.315870 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e5cf0-9629-4c94-a90f-8bb76990d461 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:30.376548 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:30.377355 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:30.378178 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:30.378453 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] PATH_INFO: `/v3/users/c6c6f1d3614a4886a934f083eb214349` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:30.379580 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c6f1d3614a4886a934f083eb214349)` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:04:30.405886 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:30.453598 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c6f1d3614a4886a934f083eb214349'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.459811 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c6f1d3614a4886a934f083eb214349'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.460584 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c6f1d3614a4886a934f083eb214349'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.461159 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c6f1d3614a4886a934f083eb214349'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.468689 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.notifications [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c6f1d3614a4886a934f083eb214349'} {{(pid=66414) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.485095 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1432/2858] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Apr 8 03:04:30 2022] DELETE /identity/v3/users/c6c6f1d3614a4886a934f083eb214349 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:04:30.696680 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Authenticating user token {{(pid=66413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:30.698140 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.fernet_utils [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:30.711200 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01199-23a6-4a25-a3fe-26e99e018b15 admin admin] Validating token access rules against request {{(pid=66413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:30.774844 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53f94523980e4b8c8b9272803bd96ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b654bd89267e40c6bd627b095329b06e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:30.775640 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:30.775928 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:30.776208 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] PATH_INFO: `/v3/projects/152098382d404cbdb5261f1d56a88f6c` {{(pid=66413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:30.777279 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=152098382d404cbdb5261f1d56a88f6c)` {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:04:30.803013 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] RBAC: Authorization granted {{(pid=66413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:30.851267 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152098382d404cbdb5261f1d56a88f6c', 'request_id': 'req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.858089 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152098382d404cbdb5261f1d56a88f6c', 'request_id': 'req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.869084 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152098382d404cbdb5261f1d56a88f6c', 'request_id': 'req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c'} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.879530 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] The token cache is being invalidate because project 152098382d404cbdb5261f1d56a88f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 03:04:30.879813 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.880473 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: DEBUG keystone.notifications [None req-6af1f37a-43ff-4ed7-8c36-d4d1c87d316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:04:30.882093 dv-cinder-837052-1-iscsi devstack@keystone.service[66413]: [pid: 66413|app: 0|req: 1427/2859] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Apr 8 03:04:30 2022] DELETE /identity/v3/projects/152098382d404cbdb5261f1d56a88f6c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:07:58.495729 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Authenticating user token {{(pid=66414) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:07:58.497088 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:07:58.651494 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4849a-7f2a-4fd7-9275-f5b03af256c0 admin admin] Validating token access rules against request {{(pid=66414) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:07:58.713946 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4068eaf366e54d0e88043780889a0893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e59f47efdd4248db9900ec38a64d16f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66414) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:07:58.714522 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] REQUEST_METHOD: `GET` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:07:58.714837 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] SCRIPT_NAME: `/identity` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:07:58.715117 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66414) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:07:58.716755 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.fernet_utils [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66414) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:07:58.727350 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Apr 08 03:07:58.753578 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930167ae-f792-4de6-bd2e-c36e0667428c service placement] RBAC: Authorization granted {{(pid=66414) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:07:58.763024 dv-cinder-837052-1-iscsi devstack@keystone.service[66414]: [pid: 66414|app: 0|req: 1433/2860] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Apr 8 03:07:58 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)